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An audio program and mes- 
sage distribution system in which 
a host system organizes and trans* * 
mits program segments to client 
subscriber locations. The host or- 
ganizes the program segments by 
subject matter and creates sched- 
uled programming in accordance 
with references associated with • 
each subscriber. Program seg- 
ments are associated with descrip- 
tive subject matter segments, and 
me subject matter segments may - 
be used to generate bom text and 
audio cataloging presentations to 
enable the user to more easily 
identify and select desirable pro- 
gramming. A playback unit at the 
subscriber location reproduces the 
program segments received from 
the host and includes mechanisms 
for interactively navigating among 
me program segments. A usage 
log is compiled to record the sub- * 

saiber'a use of the provided program materials, to return data to the host for billing, to adflDteHvAiu mr^iA, „..v ju » * . 

™ f^^r* to Md ^ber-generated- comments and requests to Z^fT^C^^tX^T^ 
included, in the player allow the user to perform hands-free navigation of the program mJSS X'aWZ ^ ™* mechai ^ 
aft returned to the host for retransmissions to other subscriber? The ^^r^S^^^S^Xl^T^^ 
materials which the user can selectively play to obtain credits against the sutaeribeHee PaSlS a^S^L^ ! dve ^ in 8 
«lec« programming enable subject maW searching and synlronization oTmTaSo KXtS £3? ™ t 
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System for Distributing Personalized Audio Programming 



Field of the Tnventinn 

This invention relates to electronic information distribution systems and more 
paricularfy to a system for dynamically and interactively selecting and playing particular 
programs from a program library. 

Background nf the Invention 

The three dominant commercial systems for providing audio programming to a 
listeners are broadcast radio systems, cassette tape playback systems and compact disk 
playback systems. 

Broadcast radio uses both the AM and FM frequency bands making a large 
number of simultaneously broadcast programs available on an essentially random access 
basis. Unfortunately, since most broadcast stations attempting to appeal to the same 
general listening audience, much of the programming is duplicative and special interest 
programs arc broadcast on a limited basis. In addition, because there is no convenient 
way for listeners to be aware of the wide variety of materials scheduled for broadcast, 
most people listen to only a limited number of stations which dependably broadcast the 
programming considered to be most acceptable. Even when desired prognunming is 
found, it must typically be listened to when it is broadcast; that is, at times chosen by the 
broadcaster and not the listener. 

Tape and compact disk audio playersjofier the listener the opportunity to purchase 
specific music selections or albums performed by favorite artists and to replay selections 
from these purchased recording whenever desired. Pushbutton track selection, as well 
as improved fidelity, has made the CD player the preferred choice of many, despite the 
cost and inconvenience of purchasing a library of desired disks. Unfortunately, specialized 
information prograrnining, unlike music, is largely.unavailable on tape or disk, and that 
media is not capable of adequately conveying rapidly evolving information such as local 
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and world news, weather reports, and rapidly changing trade and business information .' 
Although broadcast radio provides adequate, up to the minute coverage of general news 
topics, specialized information continues to be largely unavailable on any of these three 
audio delivery systems, not withstanding the feet that radio, tape and CD players continue 
to be widely used, particularly in automobiles, for general news and music programming. 

More recently, Internet radio" sources has been introduced which make files of 
audio program material available for downloading on the World Wide Web using 
conventional web browsers to locate and request specific files which are then played in 
real time by special programs, including the popular "Real Audio" program offered by 
Progressive Networks. Although Internet radio systems inake h possftle to deliver a 
richly diverse selection of audio programs to mterested lisUmers on request, m^^ 
specialized information not offered by conventional broadcast media, the use of a visual 
web browser to «arch for and men play 

conventional Internet radio players impractical for routine desktop use, and wholly 
unsuitable foruse by an automobile drive. 

It is accordingly an object of the present mvention to provide easy access to rich 
selectionofaud^ 

locate and select desired prograrnming from the available collection in an easy and 
mtuitive way wimenrt me need for a v^ 

controls. 

Summary of the TnvAntf» n 

In a principle aspect, the present invention take the form of a personalized 
mformation delivery system which provides information and entertainment programming 
tofcdrvidualsubscii^ 

and winch incorporates mechanisms for selectively delivering a subset of those programs 

toagwensubscnT>erba^ 

and interests, and express requests. 

. As contemplated by the invention, the library of programs is created and 
mamtained by a server subsystem to which a remotely located subscriber / player 
subsystem can connect by means of a conventional data transmission Hnk, such as a dial 
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up Lrtemet connection. The programs making up the library are subdivided into program 
segments, one of which contains an audio presentation of the content of the program and, 
if that content includes a voice narrative, it is preferably accompanied by a text file 
transcript Each program segment is associated with a subject category description which 
5 typically describes a plurality of related program segn^ 

description describes the content of each individual program segment Combinations of 
these category and program descriptions which are of interest to a particular subscriber 
are transferred from the server subsystem to that subscriber'* player subsystem, thereby 
providing a subject matter catalog from which the subscriber may expressly request 
10 particular programs. 

htheiwefe^emboaunem^ 

subscriber, the server subsystem aa^ from the subscriber indications of 
generdinta^charact^ 

is periodically matched against the <W«isti M of each stored pro 
15 identify those segments of significant potentid app^ 

programs supplied to the user may accordingly be limited to, or otherwise emphasize, 
categories and selections to which the subscriber's attention should be specifically 
directed. 

In order to match the subscriber's preferaices tomeprograminiiujmort 
20 match those preferences, the server subsystem crates ^ 

characterizing a series of attributes of persons likely to have an interest in that program 

segment The server former mc^me^ 

against the attributes of each program segmem to fora a wd 

extent to which the preferences of the subscriber match the attributes of the target 
15 a^ence for that program. Programs which nave the highest weighted value for a given 
user are men brought to the attention of that user, either by inchiding those programs in 
the user's catalog, or by mctoding the programme 
when space permits. 

Ot^asjjectsofmeaudodistr^ 

me listener to add a voice annotation to a program and send the annotated program to 
another listener, techniques for synchrony 
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ormorestoredimages, techniques for employing a usage log generated by the listener's 
a^todetenmnewhatprogr^^ and techniques 

for responding to control commands received from the user in providing the 
programming/ 

Hiese and other objects, features and advantages of the present invention may be 
more completely understood by considering the following detailed description of a 
prefeiredeinbocliinentofthemv In the course of this description, reference will 
fluently be made to the attached drawings. 

Brief Description nf fli«> Drawing 

FIG. 1 is a block schematic diagram of an electronic program and advertising 
distribution system which embodies the invention; 

FIG. 2 is a flow chart illustrating the I>rmcnjle steps foUowed in the course of the 
perforating the information distribution functions contemplated by the invention; 
FIG. 3 is a flow chart illustrating the prmdple steps performed durii^ a pla^ 
15 session in the illustrative embodiment; 

' WG.4 is an infor^on struck 
in which programming is selected and accounting functions are performed in the 
illustrative embodiment of the invention; 

FIG. 5 is an information structure diagram Miistrating the manner in which the 
program segments are dynamically selected and played in response to the user's 
preferences and control decisions; 

FIG.. 6 is a flow chart which describes a preferred procedure for preparing the 
program content which is distributed to subsm^ 

FIG. 7 is an information structure diagram illustrating the manner in which a 
25 narrate 

fotiiecombhationofan^ 

by the player to create a multimedia presentation. 
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Descrintion of the Preferr ^ F, m hn,« TO f!lt 

The illustrative embodiment of the invention shown in Fig. 1 utilizes the Internet 
to provide conimunicattons between a host computer indicated generally at 101 and an 
audio player device illustrated at 103. ' 

Subscriber Audio Player 

The player 103 may be advantageously implemented by a conventional laptop or 
desktop personal computer including a processor (the client CPU 105), a time of day 
dock 106, and a data storage system consistmg of bora ^ 
liersistemiiassstor^ 

being usedibr storing audio, text and image d 107 and for storing usage data at 109 
whiArecoidsthei^atureoftheprogram^ Ttoi*^ 
103 fiumerincmdes asouiul card 110^ 
. device III for accepting voice o^onaiidcoinma«ulsfrom^ 
audio output to a speaker 113 in order to supply audio information to the user. The 
program data stored at 107 may advantageously include compressed audio recordings 
and/or text (ffles of character) whi* 
speech synthesis programs executed by the client CPU 105. 

The sound card 110 is conventional and preferably complies with the 
recomm ^ ons detaaed « Ae Hardwarc y^ m iinhh fn, Mw».„ ft WnT<mr , ^ 
byDougHopfeist^ 1-55615-642-1. The sound card 

UOadvantageoush/sup^ 

coiwei^ntfsMouiputsi^ 111 as well as digital to analog 

conversion for programing directed to the speaker 111. The sound card provides 
external connecti(ms and hardware support fo Line-In, Line-Out, and 

Headphones-Out, with volume controUed by the play^ 
level logging as discussed later in connection with Kg. 3 of the drawings). 

To support multimedia capabilities, the CPU 105 should meet or exceed the 
capabilities of an Intel 486 DXZ-66 computer to provide consistently good playback 
results and the sound card 1 1 0 should include tf 1 6-bit digitat-to-analog converter for 
playback and a 16*h aiialog-to^gh^ 
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should further support 8, ll,22,i^44^^^ ms . A&tquencyofM^ is^ 
for CD-quality sound and fractions of 44, such as 11 and 22, are often used for 
compressed wavefbrmsmeam to save CPU processing. Support for an 8kHz frequency 
should be in order to property support Window 95 TraeSpeech™^ 
is optimized for compression and playback of human speech. Using TrueSpeech 
compression, programs containing largely voice narrative data can be substantially 
condensed, and users can record annotations and voice mail responses as discussed 
later. 

m addition, the sound card 110 shomd be capable of reprodudng downloaded 
MIDI (Musical Instrument Device Interface) commands, enabling the system take a 
MIDI data stream and produce sound according to the compressed files consisting of 
digital sheet music instructions. Preferably, the sound card should support at least 16- 
voice polyphony (the ability to play several sounds at the same time), andpolymessage 
MIDI, an capability included in Windows 95 that allows a sound card to receive and 
batch-process rauWple^ Thesound 
card lW shouldalso aimcrophoneportformicrophonein;aspeato 
one ortwo (stereo) unpowered speakers 113, and a headphone-out port 

Hie personal computer CPU 105 is also preferably connected to a conventional 
personalcomputervideoc^ 

device (such as a mouse, trackball or touchpad, not shown), the ftcilities provided 
by the operating system, such as Windows 95, typically includes multimedia support, 
as noted above, as weil as a standard WINSOCK T(CP/n« stack and modem dial up 
driver software to support a SLIPP/PPP ^ Iitt^ connection, as next to 

the player 103 further includes a conventional high speed data modem 1 15 for 
receiving (downloading) thep^gnuninfbiination 107 from the remote server 101 and for 
tamsnitting (upload 

ffle 109 to the server 101. To effect these file transfers, the modem 1 15 is connected via 
conventional dial up telephone SLIP or PPP. TCP/IP series data communication link 1 17 
to an Internet service provider 121 which provides access to the Luemet. The service 
provider 121 is in turn connected to the host server 101 via a high spe^ 
at 123. 
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Host File Server 

The host server 101 provides a FTP server interface 125 which provides file 
transfer protocol services to the player 103, a CGI interface 127 which performs Common 
Gateway Interface script program execution m respoiise to requests fiom the player 103, 
5 and an HTML interface 129 which provides hypertext transport protocol (HTTP) World 
Wide Web server functions to the connected player 103. The host server 101 stores and 
maintaiiisapliiralityofdatoffl 

130 consisting of a collection of compressed audio program segments 131, announcement 
Cglue") segments 132, text program segments 133, image segments 134, advertising 
10 segments 135 and program catalog information 137. 

The compressed audio segments program segments comprise audio voice and 
music files whichmay be compressed using conventional conmressionmechaiusms suited 
to the data being compressed, such as TrueSpeech compression for voice signals and 

MDIfiles for compressed synthetic music repro(lucible by the sound card 110 as noted 
15 earlier. 

Compressed voice programming in the database 131 iiiay advantageously be 
accompanied by text transcripts (files of characters) stored in the text database 133. 
• Simflariy, images stored in the image database 134 may be used to provide a multimedia 
presentation which combines images reproduced on the display 118 of player 103 with 
cxmcurrenuy presented audio at the weaker 113 and/or clisphyed text. Prog^ 
which present advertising , iUustrativ^ shown as being resident 
135 In Fig. 1, may likewise consist of audio, text and/or image segments, as may the 
P^gn^segment^^ 

audible and visible menu options which the user may select as described later. 

As hereinafter described in connection wim Kg. 5, e^ 
segment preferably includes a sequencing file which contains the identification of 
Wghfigh^ passage This sequencing 

ffl^niayh^cbiEam refers . 
inthe audio presentation when each irnage display should begm and end 
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multimedia programming. 




rinfennatiMwhichisavaU^ 
i^soim^^etc/mvbe^ 

oftexttospeechispre^ ^ 
way, text information alone may be rapidly downloaded from the server 101 since it 
requues muchless datathan equh^t compressed audo ffles, and ^ 
iurtherprovaestheuser^ ^ 

cases, where it is important to capture the quality and authenticity of the original analog 
speecn signals, atext transcript file wM«m collate^ ^ 
audio file may be stored in the database 133 from which a transcript may be made 
available to the user upon request. 

TtehDst server 101 further stores web page data 141 which is made available to 
the player 103 by means of the HIML interface 128. The host server 101 additionally 
stores and rnaintains a user data and usage log database indicated at 143 which stores 
uploaded usage data received from the store 109 in the player 103 via the Internet 
pathway 123 and the FTP server interface 125. tie user data 143 further contains 
addition ^ describing the preferences, demographic characteristics and program 
selections unique to ^subscriber which is developed larger^ 
obtaMwtouserasubmhH^ 
ty$eCCTmeduuiisml27. 

T*ehc*server 101 period^ 
lecervinga^ The file 145 is placed in a predetermined FTP 

download ffledirectory and assigned a ^^^fflename known to the player 103. Atatime 
dete^ty pUyer 103 mom^ringmetin^ 

established via the service provider 12 1 and the Internet to the FTP server 125 and the 

The ,compilation 145 is previously written to the download directory by a download 
T^cessingiriec^ D„^ |IIOOe ^ M j^ 
in more- detail later, extracts from the library 130 data defining compressed program, 
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advertising, and glue segments, and/or associated text program data, based on selections 
and preferences made by (or inferred for) the user as specified in the subscriber data and 
usage log database 143. 

The download compilation file 145, though represented as a single file in Fig. 1, 
preferably takes the form of one or more subscriber and session specific files which 
contain the identification of separately stored shamble files. By way of example, the 
recommended order and the identification of the program files making up an individual 
playback session are stored in a session schedule file (to be described in detail in 
.connectibn with Fig. 5) which contains program identifiers of the program segments to 
be played during an upcoinmg session. The player 103 downloads the session schedule 
file and then issues download requests for those identified program segment files which 
are not already available in the player's local storage unit 107. 

Usage data in the store 109 maintained by the player 103 is preferably uploaded 
as a file bearing a predetermined file name indicative of the particular subscriber and 
upload time and stored in a predetennined FTP upload directory. This upload 
advantageously occurs at the same time the player 103 establishes a download connection 
to the FTP server 125 as noted earlier, and occurs prior to the download of the 
coinpilation 145 : Because the upload data from the store 109 in the player 103 identifies 
program segments desired by the subscriber, program segments newly requested by the 
user are appended to the compilation 145. Ndte that, in typical cases, programming in 
addition to the specifically requested programming will be included in the download 
compilati(m,aiidtlietransn» 

uploaded user selections and omer information are being processed as indicated at 153 to 
identify additional information to be included in the download compilatioa 

As indicated at 161 in Fig. 1, the tort saver upload processi^ 
also provide) a number of reports, as described mmcro 

of actual player use by individual subscribers and the community of subscribers as a whole. 
This report processing is advantageously performed on a periodic basis in connection with 
financial and accounting fimctions including subscriber and advertiser billing, content 
provider royalty payment accounting, and marketing analysis processing. 
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It should be understood that numerous other information storage, processing and 
communicatibns schemes may be substituted for the preferred Internet server and PC 
client player lutshitecture shown in Fig. 1. A dedicated host computer which 
comiramicates directly with client stations via dial up telephone facilities may be used, and 
cellular radio, cable modem and satellite links may be used to provide data 
corntnunications in lieu of the conventional SLBVPPP telephone and Internet links shown 
mFig.1. Tofc^eusetfto 
linked to the Internet viaa 

link when the car is parked at the subscriber's home or office; The Infrared Data ' 
Assodatforfs (IrDA) wireless infrared QR) standard provides a highly effective, low-cost 
commuri^onap computers 
and PDAs. The IrDA international standard provides interoperability among widely 
diverse systems, involves no govermnentd regulation, are prodded at lo^ 
high speed file transfers (e.g., 4 Mbs data rates), are small and can be easily incorporated 
into portable computers of the type which may be used in a car or on public 
tnmsportation. Alternatively, the files dowidoaded from the host may be stored on a 
«pfaceable media, such as an optical disk cartridge, which may then be inserted into a 
portable.computerorsim^^ A direct link between a mobile 

client player (such as a laptop PC) may be implemented using the Cellular Digital Packet 
Data(CDPD) service presently available mir^orinetropoKto 
access to the Intemetusing the TO>/IPpro^ and provides the advantage that needed 
im^gnmisegmaitscanbe 

for a complete download before the mobile unit is disconnected from its data source. 

Upload and Download Sequence - Overview 

Kg. 2 fllustrates the sequence of major events which are executed the program 
dssanination system contemplated by the inventioa 
As indicated at 203, an interested subs^ 
wpp^ng personal mforniation a^ 

totalization procedure. Preferably, as explained in more detail later, account 
initialization is accomplished by presenting the subscriber with HTML forms to complete 
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and submit to CGC script programs which execute on the server to post subscriber 
wppUed information into an initial user dataset. Based on the information supplied by 
the user, the server then compiles one or more files for downloading to the subscriber at 
step 207 which include prograinming and advertising segments as well as additional data 
and utility programs needed by the player 103 to begin operation. The download 
operation preferably occurs at a time established by the player which establishes a dial up 
connectionviatheSLMOT 117 to me local Internet service provider 

121 which provides anfotenurtcomectiontot^ The download file 

or files containing programming and advertising segments as well as subscriber specific 
data are designate by filenames provided by the requesting client/player 103 and moved 
from storage unit 145 utilizing the FTP server 125 and the Internet connection into local 
storage at 107 in the cKent/player 103. The filenames used to specify the files in the 
server 125 may conveniently be formed from the programed value used internally by both 
the host and the player to identify and differentiate the different program segments used. 

The data downloaded includes a recommended program sequence file which 
proviaonaUy identifies the order in which downloaded program segments are to be played, 
wMithehutiaJ selection and sequence being established b^ 
the download compilation processing mechanism seen at 151 at the server. 

Before a playback session begins, as indicated at 211, the subscriber has the 
opportunity to review and alter the provisional program selections and sequence 
established as a de&ult by the downloaded information from the server. Utilizing the 
programming data and a utility program previously supplied by the server, the subscriber 
may alter the selection and sequence of fm>gramina^ including ahering 

the extent to which advertising will be played along with the selected r^grairirning. 

Atthe request of the user, the sequence of progranmimg defined by the program 
sequence file (the selections file illustrated at 351 in Fig. 5) is then reproduced for the 
listener. Asamtemplatedbyt^ 

the user to easily move from program segment to program segment, skipping segments 
in a forward or reverse direction, or to jump i to a particular segment, and thus alter the 
preprogrammed sequence. Nevertheless, whc»^^ 

the next segment which is specified as foUowing.the given segment will begin playing 
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unless the listener intervenes. Thus, although the segments are stored in randomly 
addressable locations in the local mass storage unit, they are nonetheless played at step 
212 in the sequence established initially by the server and (optionally) modified by the 
subscriber, with the player providing the ability to dynamically switch to any position in 
this sequence under the listeners control As indicated at 213 in Fig. 2, the listener may 
at any tune return to the sequence editing step 2 1 1 to manually reorder the playing 
sequence if desired. As indicated at 215, a session usage log is recorded during the 
playback s^ me volume and speed at which 

that segment was played, and the start and end times. 

At step 2 1 1 , in addition to deleting and reordering items on the program schedule, 
the user may alter his or her selections and general subject matter preferences to control 
the manner in which the host assembles program schedules for fo^ When 
IirogiaiiBttemchidedmacuir^ 
nayassignaprioiityv^ 
the user has an interest m 

categoriesin which the identified program is classified. Wen a program ma serialized 
sequence is assigned a new or different priority value at step 21 1, the host system 101 
assignsacoirespQi^ 

remauiing unplayed programs in that serialized sequence. Note that, by expressly 
approving advertising segments or categories of acceptable advertising in this fashion, the 
sifcscribermaybegr^ 
inc«foradveTtisii^ 

.Attiwctmclusiontfase^ 
P"gra»n%whi* Tofacffitate 
this selection process, additional programming which fits the subscriber's indicated subject 
hiatteinieferen^ 

of particular imerest, is identified in a catalog (as periodically supplemented by a 
download file seen at 308 in Fig. 4) and presented to the user in the form of a proposed 
pxpgram schedule together with a catalog of additional selections which may be 
substituted or At step 219, the selections made by 

the user at 217 as ,well as the contents ofthe usage log recorded at 215 are uploaded to 
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the server as a requested file (seen at 301 in Fig. 4). This upload step may occur at the 
same time the SUP/PPP dial-up connection is established by the player 103 to accomplish 
thft download, with the upload occurring first by an FTP file transfer from the usage data 
store 107 to the FTP server .125 followed by the downloading of files requested by the 
client 103 from the FTP server. 

In addition to the downloaded catalog of available Hems which may be viewed by 
the subscriber from the available downloaded information, the user may re-establish an 
Internet connection to the HTML web server 129 which presents HTML program 
selection and search request forms, enabling the subscriber to locate remotely stored 
programming which may be of particular interest to the subscriber. When such programs 
are selected in the HTML session, the user's additional preferences and selections may be 
posted into the user data file 143 andmeidemfficationof the needed files may be passed 
to the client/player 103 for inclusion in the next download request. 

Account Initialization 

As corrtemplated by the invention, a subscriber account may be established by any 
userhavingapersonal cam^ equipped to pr^ need ed to implement 

the player 103 as described above; together with Internet access via a service provider 
121. Ahhoughaconvoiti^ 

time required for uploading and downloading ^ me necessary ffles inay bo substantiafly 
reduced using higher speed access, such as an ISDN or cable modem link, when those 
services are available. 

To estabEsh a account, airospectwesiibscrib^ 
browser program, such as Mosaic, Netscape Navigator or Microsoft's Internet Explorer, 
which executes m the cUem 105 to es^ 
2$ dialog with server 101. The account initialization begins with the transmission of an 
HTML form from the web page store 14 i which is completed by the user at the keyboard 
(not shown) of the client CPU 105. The account information is then transmitted to using 
aHTTP post method directed at a form processing CGI script executed by the server at 
127 to place descriptive information about the user in an assigned user data file as seen 
at 143. After the. account has been established, ut% programs and data may be 
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downloaded from the FTP server 125 to the dieht/playa' 103 . These utility programs 
advantageously include programs which perform functions including (a) program 
decompression, playback and navigation; (b) recording of a usage log file identifying the 
program and advertising segments played and the start time, ending time, volume level and 
playing speed for each such segment; and (c) the selection and updating of programming 
preferences and selections for future downloading. 

The data fields supplied by a new subscriber at the iimiauzation step 203 may 
advantageously include the user's fuU name and billing ad^ 
or the like for use in subscriber billing; and descriptive data about the subscriber (and 
©there who inay share tte down^ 

status; the identification of subject matter categories of interest to the subscriber, 
prefix with assigned weigbiiig factors tndi(^ the level of interest in each category. 
The subscriber may also indicate general preferences with respect to the including 
advertising, including an indication of the amount of advertising which is acceptable to 
defray subscription costs, ranging from fully advertised programming for minimum 
subscription charges to the complete exclusion of advertising. 

In addition, the subscriber may request and be presented with an HTML form 
which lists available programs in a particular selected subject matter area, whhapriority 
weighting factor pre-assigned to each in accordance with the subscriber's previous 
specification for that category. The form presented thus reflects the previously entered 
level of interest weighting factor for each program based on its subject matter category, 
but permits the subscriber to override the suggested default value on a program by 
program basis. Similarly, me subscriber is given me ojmortuiuty to override me defiult 
amount of advertising desired. 

Advertisingmay be associated with particular siibjectiiiatter categories 
with particular programs. For example, an airline may wish to advertise generally in 
connection with programming in the "travel" category whereas a particular resort hotel 
may wish to advertise omy in connection with a particular travelogue program for the 
region where itis located. Subscribers may wish to hear advertising in connection with 
the programming in the travel category, but to eliminate commercials from a dairy 
jm>gnunpreseiiting today's weather report." Tberesuttisclearryadvaiitageous form^ 
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advertiser, since advertising is focused more clearly on those having an interest in the 
subject matter and an expressed willuignessto listen to commercial messages, while the 
subscriber is able to receive advertising which may be regarded'as useful while eliminating 
unwanted advertising. 

Because personal data describing each subscriber's subject matter interests is 
available, along with personal data (age, marital status, zip code, etc.), particular 
advertising segments may be directed to only those subscribers having a likely interest in 
the goods or services advertised. This targeted advertising need not be presented at any 
time during the playback for the designated subscriber and need not be timed for 
presentation with particular programs. For example, a subscriber indicating an interest 
in travel progranniing may be supplied with acrvertising from an airline at any time, and 
not necessarily concurrent with selected travel prograrnming. 

Because a subscriber may have a particular interest in or enjoy some advertising, 
and may have a particular dislike for other specific advertising, the user may 
advantageously be presented with a listing of advertising organized by advertiser and 
subject, providing the subscriber with me opportunity, to select additional desired 
advertising on the list while suppressing others: Since the voluntary acceptance of 
advertising preferably reduces the programming charge to the subscriber, the utility 
program which executes on the client CPU 105 to enable program and advertising 
selection, sequencing and editing preferably provides an advisory indication to the 
subscriber of the charges or credits to be accrued if the currently programmed sequence 
is played. This feature enables subscribers to better control the costs of the service by 
accepting sufficient advertising content to reduce the subscription cost to an acceptable 
level. Subscribers may also set a player system variable to a value indicating the 
subscription costs p^ 

can then automatically insert advertismg segments between progr^ 
quantity to achieve a net charge at the desired level. 

Player Operation 

• The playback operation indicted generally at 212 in Fig. .2 is illustrated in more 
detail in Fig. 3. 
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to order «> faj, Wo»»-to the downloaded prognnuntag materials to the 

■m^rmatio. whjci. night be r,™,!,,, e,,,^ „ Mvi(hjl ^ — 

««v» 101 is advantageously password protected. 

^^^•."sacaoraitto^ 

ttot^«^ eFTOgI ^^^ Waici ^ Tothisend.tnectat.nd 
^•odsoftop^r^^^^^^^^^^^ 

W«-M>U s i^fa. Brpi^«hed toyp «io»c.p*i % witHllflle 
c^of«hep^^^ ilclpa H erf( ^ de ^^ o ^ totiM 

^'•'^.^^.c^tat.HKto.S^ 

"**" and * . par, of m ^ mma6B ^ 

—mm. the host *m can ta pmBmmei to ^ ^ ^ tf aiitjoM 
^^(SomwU*.,^^^^^^^^ 

from the FTP server 125. -~e> 
As described in more detail later to connection Hgs. 4 and 5 .theseoueace 

mF *««»^ofa.«6.u^ 

used to compile a sentencing fie, called the selection* fuVinusoWed at 351 to Hg. 5 
«U* chains more tort* bfemtdioo shout fte .i^. ^ ^ 

in the manner illustrated in Fig. 3. 
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As indicated at 233, the playback session begins with the presentation of an audio 
(and/or displayed) menu which allows the user to jump to any program segment within 
that sequence to start (or resume) playback at 235. or terminate the session at 236. 
The playback operation itself continues from the designated playback point in the 
selections file (seen at 351 infig. 5) which follows a program sequence initially created 
by the host server and downloaded with the program segments themselves, and then 
(optionaUy) modified by the addition, deletion and re-sequencing of segment identifiers 
as discussed earlier in connection with step 211 in Fig. 2. Note however that, if the user 
elects to have advertising segments automatically inserted between program segments to 
achieve a predetermined cost level, mat insertion Occurs under the control of the playback 
mechanism at 235 such that advertising segments not identified in the selections file may 
be added or advertising segments specified in the selections file may be automatically 
skipped. 

As playing progresses, the current playback position may be advantageously 
15 •uidicatedbyavarietyofmeans. In the most simple form, the current playback position 
within the session file of selections (discussed in more detail in connection with Fig. 5) 
may be indicated by a simple numerical readout indicating the position on a scale of 1-100. 
.In this way, a user listening to the programming in scheduled order is provided with an 
indication of the duration of programming remaining to be played. In a player 
implemented by a personal computer provided with a screen display, the current playback 
position may be advantageously indicated by displaying the program segment topic 
descriptions in a scrolling fisting, with the description of the program currently being 
displayed being highlighted. The scheduled duration of each program segment may be 
displayed, along with the elapsed time remaining to be played in the currently playing 
segment, to enable the user to more easily determine when to skip the remainder of the 
currentiy playing segment When such a concurrent ^visual display is available* means may 
also be included to respond to the users selection of a given program on the scrollable 
listing by means of a mouse or the like, and then automatically continue the play at the 
be ginn ing of the program segment thus selected. 

Each time the playback begins a new programining, advertising or announcement 
segment, the segment start time is recorded in the usage log file stored at 109 (Fig. 1). 
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Each usage log record contains a program segment identification number (ProgramlD) 
obtained from the selections file as well as a start time and date stamp encoded into a 32 
bh date-time value, a volume level setting indicating the volume at which the player was 
set at that time, and a playing speed value indicating the playing speed or playing being 
used. 

As indicated at 237 in Fig. 3, each time a new program segment is started, a hew 
segment handling procedure is executed at 239. If the user desires to have advertising 
inserted to defray the costs of the subscription, the current actual cost per unit time is 
calculated aid compared wim the d If me cost is determined to 

exceed the desired level, an additional advertising segment is started; otherwise, the next 
program segment in the program sequence 214 is played. In either case, the segment id 
of the newly starting segment iff recorded in the log file along with the start time for that 
segment Note that it is unnecessary to record the end time for the prior segment 
it is the same value as the start time for the next segment. When play is concluded, a 
terminating record indicating the time of turnoff is recorded to enable the duration of the 
last segment to be calculated. 



Recording Volume and Playing Speed Changes 

As indicated at 251, if the user changes the volume level or playback speed by a 
significant amount, a new record is posted to the usage log at 253, indicating the 
continuation of the last program at a new volume level (thus producing two records in 
sequence having the same program segment ID numbers but having differing start times 
and volume levels). The user adjusts the volume by means of a software control 
displayed when the player is active. The user adjusts the control using the mouse or 
keyboard to adjust the volume. When the volume control experiences a change in level 
25 8*Wthanaim*eteimu^dev^ 

c^thenewwlunttlevdtober New volume settings do not affect the 

program sequence and the recording of the volume level change takes, place transparently 
to the user. likewise, when the user changes the playing speed, or switches to highlight 
mode, the new playing speed setting is recorded (using the PlayingSpeed variable in a 
30 Usage Record, to be discussed) 
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The cost accounting program which calculates subscriber charges and fees to 
advertisers may thereby treat volume levels below a predetermined threshold leVel, or 
playing speeds in excess of a certain level, as being equivalent to skipped prograiriming. 
In addition, if a subscriber reduces the volume on selected programs or programs in 
particular subject matter categories, frequently increases the volume for other programs 
or subject matter categories, or sets the playing speed to play highlights only of other 
programs, that data can be used to infer preferences and dislikes which can be used to 
better select desired programming to be included in future download compilations. 

User Playback Controls 

The player mechanism seen at 103 includes both a keyboard and a miorophone for 
accepting keyed or voice commands respectively which control the playback mechanism. 
As indicated at 261, the receipt of a command, which may interrupt the playback of the 
current selection, and the character of the command is evaluated at 262 to select one of 
six different types Of functions. 

The player 103 responds to the first command, "Accept" indicated at 263, by 
temporarily suspending the playback in order to accept a spoken "comment" from the 
userwMchisrecoidedasiri After the conclusion of the comment* control 

is returned to 261 to test for additional commands before playback is. resumed at 235! As 
described in more detail later, comments dictated by the user are saved and later uploaded 
to the host system where they exist as programjsegments. By allowing the user to dictate 
and record comments, the system provides a number of useful capabilities, including 
posting comments and messages to the host (requests for help or additional information), 
posting comments and messages either privately or publicly to the originator of a program 
segment being played, thereby enabling private interchanges to occur between users, to 
enable the interchanges to take place miwbficly avails 

and Ustserv newsgroups employed on the Internet to facilitate public discussions related 
to predetermined topics. In addition, the ability to accept and upload user-generated 
comments and information provides a valuable mechanism by which the user can evaluate 
and comment on the program material being provided by the host. As described later in 
connection withEgs. 5 and 7, the mechanism seen at 263 and 264 for mtroduang a pause 
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in the session playback while a voice response or comment from the user is recorded can 
also be employed to produce program generated prompts which request information 
followed by automatic response recordings, thereby enabling the system to be used to 
collect data, program evaluations, and other information from the user.** 

A first command, ?Go n indicated at 265, causes the player to make an immediate 
shift to a different program segment. For example, the spoken voice command "FIVE" 
can indicate a request to go to a predetermined numbered program segment while the 
spoken command "NEWS" could switch to the subject announcement segment for news 
programs. Afternativery, a mouse click on a screen-displayed menu of items, or a push- 
button on a hand controller connected by an infrared link to the player computer, could 
siinilarry be processed as a command to go to a predetermined program segment 
associated with that command signal. In such cases, the system records the start of the 
new segment on the log file (seen at 215. in Fig. 2) at 267 and switches the current 
playback position in the program sequence file 214 to the new setting at 269, and the 
playback continues at 235. 

In the preferred arrangement, described in more detail in conjunction with Fig. 5 
of the drawings, the program being played may contain passages which relate to other 
program segments in the compilation. These passages may be indicated by direct 
anncwncement, such as: "Say *Go' when any of the following automotive companies are 
named to obtain additional information; .. Ford ..General Motors .. Chrysler .. Honda ..*» 
Aternatrvely, an audible cue signal, such a awtinctive tone or chime, might immediately 
precede a passage which anchors a link to another program segment. Players equipped 
with stereo audio output capabilities can make , cues distinctive by playing cued 
announcements in one stereo channel, with or without a supplemental cue signal in the' 
other channel. When a cue signal indicates a hyperlink passage, a simple "Go" voice 
command causes the player to reset to a new location from which playing continues until 
a "Return" command, seen at 266, causes the player to return to the original sequence. 

As discussed later in connection with Fig. 5, hyperlinks of this type may be used 
to identify program segments which are not available in the player 103 because they were 
not downloaded for inclusion in a scheduled session. In that event,, the "Go" handling 
routine seen at 265 posts a record to the usage log containing the ProgramED of the 
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requested but unavailable segment so that the requested segment can be included in the 
Requested file 301 seen at 301 in Fig, 4. . 

When a communications pathway such as an Internet or cellular phone link is 
available to connect the player 1 03 to the server, an immediate request may be sent to the 
server to download a needed but locally unavailable segment. In that case, the 
downloading and playing may proceed concurrently by placing the downloaded 
information into a memory buffer to which the downloaded program segment is written 
as it is concurrently read for reproduction as described U.S. Patent 5,371,55 1 issued to 
James Logan and Daniel F. Goessling. To eliminate breaks in the program sequence, the 
player 103 may advantageously perform a look-ahead operation, sending a file request to 
the file server via the communication link by pre-souming the program sequence file 214 
to identify program segments to be played which are not in local storage and requesting 
those segments before they are needed. 

> Because announcement or "glue" segments are firequentty repeated m (liftwmt 
program segments, these segments are preferably retained in local storage by the player 
- to avoid the need to be downloaded. The player advantageously processes the usage file 
at the end of each session and tags each program segment which has been played as being 
.eligible for replacement to make room when necessary for incoming segments. 
Announcement segments, however, ate preferentially retained even though they have been 
played because of the higher probability they may again be included in upcoming session 
schedules. 

The third command, the SKIP command indicated at 275 in Fig. 3, causes the 
player to advance to the beginning of the next program segment in the program sequence, 
«»^thestartofthen« 

If the program segement has been subdivided (e.g. into paragraphs), the SKIP command 
causes the to skh> forward to begm^ 

If desired, SKIP commands may be subdivided into two types, a SKIP TOPIC command 
and a SKIP SUBJECT command. When programming material such as news reports are 
grouped into topics within subject categories, as described later in connection with Fig. 
30 5 .a^SlBJECTcomiriandata . 
that subject and resume playback at the leading description of the next subject. In 
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contrast, the SKIP TOPIC command always advances to the next topic (program segment 
or program segment subdivision) in the sequence. If desired, the SKIP TOPIC command 
can produce a jump to the next program segment or subdivision which does not contain 
advertising,. maldngfti l nnec(^fbrm^ 
the program sequence for the next desired program segment 

The. BACX cornir^ indicated at 27^ 
reverse CYewind") direction. Sinrilarry, the BACK conjmandmay be subdivided into 
two commands, a BACK SEGMENT and a BACK SUBJECT command, which 
respectively reset the playback point to the begimung of the prior segment or the 
begiimingofthepn^sub^ Note that, arte any given segment has played 

for a predetermined amount of time, the BACK command should reset the playback to be 
begiming of the current segment or topic respectively, allowing the user to start the 
current segment or topic from the beginning iinlessme playback poim^ 
begmning, in which case the transition is made to the prior segment. The system 
responds to BACK commands by resetting the playback point to the desired point in the 
sequence and recording the start tinie, volume set^ 
log file as indicated at 267. 

In the preferred form (>f me invention described in more detail in connection with 
Fig. 5, the context sensitive SKIP and BACK commands are used instead of the SKIP 
TOPIC, SKIP SUBJECT, BACK TOPIC and BACK SUBJECT commands discussed 
above. In the preferred arrangement, the program materials include subject and topic 
"""""^^ 

^advertising). When the user issues a SKIP or BACK command while the player is 
playing a subject or topic announcement, me phyer skips t^ entire subject or topic being 
announced and moves to the next subject or topic announcement respectively, 
autoiiutfcalry bypassing the fotervenuig program 
subject or topic. 

^^<»nmana\a' 
iota the usage log which io\mt^ of a program segment, 

whichtheu^enerwishesto desigMteforruhireuse. In its simplest fonn, the bookmark 
recording fonction indicated at 28 1 may simpty record a bookmark and the ProgramJD 
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ofthe cuirent program segment into log file. By bookmarking a program segment, that 
segment maybe recalled by the subscriber and all or part of it saved for later use in local 
storage, from which it may be reproduced, forwarded as an attachment to an email 
message, and the like. 

5 More elaborate bookmark functions which may be readily incorporated into the 

system if desired include the following: 

a. Dictathg or keyboaiding an 

bookmarked program segment, the annotation being saved in locai storage so 
that, when the bookmarked program segment is reproduced, it will include the 
10 annotation. Hie bookmarked program segment and the annotation may then 

be saved as a unit Tor future reference or forwarded to another person. 

b. Bookmarked program segments, or annotations to bookmarked program 
segments, may be used in conjunction as an auxiliary audio voice mail and 
email handling system in which a subscriber's email and voice mail items are 
organized as topics in the playback session, enabling the subscriber to 
bookmark particular incoming messages (program segments) for further 
attention, or to dictate voice mail responses, or responses that can be 
converted to text form by a human typist or by a voice recognition system. 
This aspect of the present invention allows the subscriber to review and 
respond to incoming email and voice maU messages whfle commuting or 
traveling to more productively utilize travel time. Voice annotations may be 
stored in separate files which are uploaded to the host with the usage file and 
keyed to the program segment passages which they annotate by records in the 

. usage log file. 
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The sixth command type, the "MENU" command indicated at 283 in Fig. 3 
switches the player to a predetermined menu progitosegmein; records the start of a 
menu mode state in the log file at 285 and places the player in the menu mode at 233: 
Using a hands free voice command system, the player may reproduce a menu program 
segment in which a sequence of options are enunciated on the system's audio output 
30 speaker with short pauses between the recited options. By providing the voice command 
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"Go" during or shoruy after, a desired option, ttauw^eii^lto^ioW to 
that selection. Menu options of this type may be conveniently implemented using the 
hyperlink capability described later in connection with Fig. 5. Alternatively, as noted 
earUer, the inenu of options may be displayed on the s«^ wim the desired playback 
point being selected using the keyboard or a pointing device, m all cases, each transition 
to anewprogramsego^isrecoidedirto 
and subsequent processing. 

•* 

Program Compilation & Billing 

Fig. 4 illustrates the principle data processing steps and information structures 
employed by the preferred embodiment of the invention to compile prograniming 
mformation personalized to the preferences of individual subscribers, to perform 
accountingfijnctions whichproduce billing charges to subscribers and advertisers, and to 
determine royalty payments due to content providers. 

Theirogran^ adveftisii«aiulaimoun^ 
individual subsciiberindudemoseprognun selections which the subscriber chooses from 
the suppfiedcatalogof recommended programs, or additional selections chosen during a 
dial^pdialogwimmehost, asdescrn^ 

2. The selections made by and uploaded from the subscriber take the form of a file 
(sem,ence)of32bhintegers, each integer (Program©) designating a particular program 
segment. This file of integers is placedin a relatioial database Revested Table se^ 
301 m Fig. 4, wnheaA. ro> (reco^ 

number which specifies a corresponding record (row) in a database table 303 called the 
Programs Table. The Requested Table 301 includes not onfy express requests from me 
user based on catalog selections but also requests which result from foiled hyperlink 
requestewlu^ 

session which was imavailable in local storage at the player. The program segments 
(which include programs, advertising and announcements) have a plurality of attributes 
which are described in the data fields of each record (row) in the Program Table 303 
The following Pascal type declarations define the content of each record in the Programs 
Table 303: 
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Type 

Classtype = (advertisement, program, announcement); 
Program JSegment = record 

ProgramID: integer, { unique key } 

ProviderlD: integer, 
' Class: Classtype; 

URI/pchar, 

Created: datetime; - 
SubjectDesc; integer, 
TopicDesc; integer, 
GroupID, Episode: integer, 
CommentOn: integer; 
Subjects: array[0..1S] of integer; 
Importance: array[0..15] of integer; 
Youngest, Oldest, male, female: byte; 
HouseLow, HouseHigh: byte; 
Duration: integer; 
Plays: integer, 
TotalTime: double; 
. PlaysRate, TimeRate: integer, 
Timeliness: integer, 
end; . 

Each ProgramJSegment record in the Programs Table 303 is identified by a unique 
key integer value, ProgramID, which is the primary key value upon which the Programs 
Table.303 is indexed and accessed. The ProgramJSegment records in the Programs Table 
303 are relationaily linked using the ProgramID key to other tables including: 

(a) the Requested Table 301 discussed above, 

(b) a Schedule Table .307 which contains the recommended sequence of 
program segments for the next playback session, 
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(c) a New_Catalog Table 308 which contains the identities of new available 
program selections to be added to the subscriber's catalog of available 
programming, and 

an Advertisements Table 3 1.1 containing entries which describe advertising 
program segments to be brought to the attention of the subscriber. 



(d) 



The relational database system employed by the preferred embodiment of the 
urventionfurther includes a Subscribers Table 313 which contains information describing 
eachsubscriber, a ^ ^ ^ ^ 

or firm which ~PPues royalty^ea^^ ^ 
an Advertiser Table 3 17 which contains information about each advertiser that provides 
advertising program segments to subscribers. Mailing addresses and other information 
for subscribers, content providers and advertisers is contained in a single Account Table 
321 to simplify the data structures needed. 

AUsage^Log Table seen at 333 is uploaded from the subscriber, typically at the 
same time the express program requests in the Requested Table 301 are transferred and 
processed at 350 to update the Subscribers Table 3 13, the Content Providers Table'*! 5 
meAdvertisemeitoT^ J. 
described below. ' 

Program Schedule Generation. 

:• Li accordance with the invention, the host server re^ and supplements m^ 
user's initial selection of a sequence of desired programs, first by adding the program 
selections specified infefled hypertext retmests vindicated by the Us^ 
during usage log processing at 350, and then by adding advertisements, announcements 
and additional program segments tailored to the subscriber's known preferences as 
nuhcated at 340 inF* < therebyprc^theieco^ Schedule Table 307 which 
is transferred to tb* subs^er, ^ 

tnmsfer: Indeed, if the subscriber provides no selections at aD, the host will prepare a 
Schedule Table 307 wntaining program segmem selected eiuirery by the ho 
subscriber's behalf The programs, advertising and announcement segments which are 
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added to the Request Table 301 to foim the Schedule Table 307 are determined by a 
matching procedure 342 which may be better understood by first considering the content 
of the data structures which provide data utilized to make those selections. 

The Programs Table 303, as noted above, contains Program_Segment records 
which describe the nature of each programming, advertising and announcement segment 
in the library which is potentially reproducible by the player 103. As illustrated by the type 
declaration above, each ProgranvSegment record specifies the . account, number 
(ProviderlD) of the advertiser or content provider if any who may be charged or 
compensated for the actual playing of the program segment by subscribers. The record 
further contains a Classtype variable Class which indicates Whether this segment is an 
advertisement, a program, a comment or an announcement. 

The Class variable may. also used to further subclass each program segment; for 
example, program segments which hold user-recorded comments may be designated as 
being "public" comments made generally available to all subscribers, "private" comments 
to be directed solely to the provider of the prOgram_segment commented upon, and 
"host"' comments to be directed to the host system. 

The Program_Segment record's URL field specifies the location of the file 
containing the program segment in the file storage facility indicated at 304 in Kg. 4 (i.e., 
normally on the FTP server 125 seen in Fig. 1, but potentially including storage areas on 
the web server 141 or at any other accessible location on the Internet). In addition, the 
subscriber may wish to designate for future play a program segment already loaded into 
the player 103 by virtue of a prior download. The subscriber may elect to include an 
already loaded file because it was not reached in a prior playback session or because the 
subscriber wishes replay the selection. In that event, the Program© of such a selection 
is nonetheless included in the i upMed sdection list (Requested 
that at the time of actual download, the player 103 will only request the transfer of those 
program segments not already present in local storage, the uploaded Requested list 301 
should accordingly be understood to be indicative of the requested content of a future 
planned playback session and not necessarily a listing of programs to be downloaded. 
The selection of files to download is preferably made by the player which issues FTP 
download requests from the server by specifybg the TJRU of me !ieeded ffles. 
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The Created field contains a timestamp value specifying the data and time of day 
the program segment, was created. In Created field allows user or host to select program 
segments by date and permits the listing of segments in chronological order in program 
catalog listings. 

The Program_Segment record further contains a SubjectDesc field and a 
TopicDesc field, both of which take the form of Program© integers which identify other 
program segment records which contain detailed information on audio announcement and 
playable text descry The descriptive text files for subjects 

and topics are displayable by the player 103 as part of descriptive catalog entries which 
enable the user to choose desired segments. Together, the subject and topic program 
segments provide a hierarchical catalog listing which provides the descriptive information 
about the associated content segments which enables the subscriber to make informed 
selections. The text specified by the SubjectDesc and TopicDesc fields may be searched 
using conventional keyword searching techniques to permit the subscriber to locate and 
identify particular programming of interest from the locally stored catalog or, in a dial up 
CXH interaction with the host, to list and select programs from the larger library available 
on the server. 

Serialked Programs 

As contemplated by the invention, programming may include serialized sequences 
of programs. A given program segment may represent an episode in a series which is 
selected as a group by the subscriber, or a subscriber may select an individual program in 
aserial sequence and the host may men forther installments or related prograir* within the 
series to the catalog or session content thereafter, sent to the subscriber. The 
Program_Segment record contains a GroupID field which specifies the series as a whole, 
and an Episode integer field specifies the position of the given program segment within 
the serialized sequence. When a serialized sequence is requested, the host may download 
the entire series in one download for playback at requested intervals, or less than all of the 
episodes when ail are not yet available or when it is desirable to limit the total download 
content When a subscriber selects and plays a given program segment, as indicated in the 
usage log, without roving expressly selecting the entire series, 1 the host may then add the 
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next installment to the catalog or the next proposed session. If desired, a hyperlink (to 
be described) may be placed at the conclusion of each installment which specifies the next 
installment as the linked program segment. In this way, the listener may request that the 
next installment be played immediate^ is ^ 
Cifit is unavailable and the hyperlink fails). . 

The usage log may be employed to insure that the subscriber has an opportunity 
to hearepisodesthatmayhave been skipped. By monitoring the usage log, if an episode 
included in any given proposed session was not in feet played, the host may include it in 
the next proposed session as well Note further that the serialization mechanism which 
has been described can be used to provide serialized advertisements to a subscriber, 
insuring that a subscriber does not hear a particular ad twice and further insuring that the 
advertising is presented to the subscriber in the intended sequence. 

Li addition, the serialization mechanism may be used to provide sequential 
presentation relationships between related programs. For example, if a subscriber 
mdicates an interest by selecting and actually playing a program on an evolving topic; for 
example, a news story about the America's Cup yacht races, further new stories on that 
topic may be assigned the same Group HJ immber so that they are automatical^ 
into the subscriber's catalog or program session if space is available. 

Fields supporting "Comments" 

Serialized programs are related to, but should be (iisunguished from, the parent- 
child relationships that exist .between program segments and the annotations and 
comments made on those program segments by users. As noted earlier with respect to 
the Accept command seen at 263-264 of Fig. 3, the player 103 ofFig! 1 permits the user 
to create an "annotation" or , "coinment" (typically fa the form of a recorded audio 
message or a keyboarded text message) which is uploaded to the host 101 and stored as 
aprogram segment Tlie CommentOnfidd ofthePro contains the 

ProgramJD of the program segment commented on, the Provider JD field identifies the 
subscriber generating the. comment, the Created field specifies the date and time when the 
comment was recorded, and the default values of the subject matter fields (discussed 
next) are copied from the subject matter fields of the program segment being commented 
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on. These field entries provide a mechanism for supporting the comment handling 
features which are described in more detail below under the heading "Comment 
Handling." 



Program Selection 

The Program ..Segment record further includes a Subjects field which is an array 
of 16 integers, each of which may be a non-aero code value indicating a predetermined 
subject matter categories, allowing each programming segment to b e matched against like 
codes specified as being subjects of interest by the subscriber, as well as codes indicating 
subjects to which advertised goods and services may relate. 

The Program_Segment record also contains an Importance field which is also an 
array of 16 integers which (at least initially) holds an integer wntaining the 
reviews/editor's assessment of the "importance" of the program segment relative to the 
subject matter code specified in the corresponding cell in the Subjects array. Thus, if 
Subjects[7] = 12345 and Importance[7]=23 1, this program segment has been assigned a 
importance level of 231 with respect to the subject specified by code 12345. Another 
segment may also be relevant to the same subject, but with a different level of importance 
to that subject These fields may be used by the host as a weighting factor used to route 
programs of greater probable interest to the subscriber. Note also The "importance" value 
associated with any given program may also be adaptively altered based on the actual use 
asxeftectedbytheiisagelogsa^^ Byway of example, 

program segments which are started but frequently skipped while in progress may have 
their importance value decreased while program which are frequently selected from the 
catalog and listened to may have their importance values increased. In this way, the 
system adaptively learns, for each categoy or programs, which programs subscribers 
have found to be of interest and which ones were seldom used. Serialized programs 
Odentified by a common Group ID) may be assigned importance values based on the 
actual usage of earlier episodes in the same series. Thus, when a series proves to be 
popular based on repeat selections of its episodes, all episodes Ctncluding those not yet 
issued) may be assigned a higher importance value. 
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The Youngest and Oldest fields (each storing a byte value 0-255) contains an 
indication of the age range to which a particular program segment should appeal. 
Similarly, the byte values Female and Male allow the entry of an estimate of the relative, 
interest of a given program to the different sexes: thus, a program devoted to sports news 
could be assigned the Values Female=60, Male=170 where the value 127 would indicate 
genderrneutral content The MaritalStatus field is a single character ("S"=single, 
"M"=manied, "Widowed, w D"«divorced). 

The fields HouseLow and HouseHigh represents a range of household sizes range 
that may have a special interest in the program segment Thus, progranimiiig Erected to 
femily interests may be directed to subscribers.who are married with a household size 
equal to 3 or more. 

The Duration field of the Program_Segment record specifies the duration of the 
program segment expressed in seconds: The Plays field is an accumulator field which is 
incremented by incoming Usage J*g records to redBiect .the total number of times a grven 
program segment has been actually played by ajl subscribers. Similarly, the Totdtime ' 
value represents the total time a given program segment has been actually played by users. 
Together, these records can be used to determine the advertising fee due ftom the 
advertiser, or royalty amount payable to the content provider (the advertiser or content 
provider being specified the Provider© field) for the use of this segment 

The Program_Segment record contains two signed integer values, PlaysRate and 
TimeRate, permitting an advertising charge or royalty payment (Amount) to.be calculated 
as a value calculated by the executable formula: 

Amoum:=(Pkys» PlaysRate) +-Cft^ ' j 

If PlaysRate = 0, the amount of the royalty or advertising fee for actual use" of the segment j 
25 cancalculated based solely on the ac^ time dur^ • 
creditor charge is assigned if the segment is begun but then skipped). Alternatively, if 
rimesRate^,thechaigecanbebas^ j 
was commenced, which may be deemed appropriate when it may be considered the j 
respoiisibilityofto j 
a segment begins. Note that, as usage records are posted to increment the Plays and 
TotalTime fields in the Program_Segment. records, as described later,, any program ! 
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segment which wasplayedfor lessthat a predetermined minimum amount of time may be 

disregard^ enabling the sub 

infonnation Per segniem^outincunmgsub^ 

fees or royalty payments. 

Program segments are selected for inclusion in the output Schedule Table 307 
and/or the NewCatalog Table 308 by comparing the content of the Programs Table 303 
the SiAsmb^Tab^ The fields contained in" 

the Subscribers and Advertisements Tables are set forth in the foflowing Pascal record 
type declarations: ~ 



10 Account = record 

AccountNo: integer; { Unique key } 
Name, Title, Company-Name: pchar, 
Addrl, Addr2, City; pchar; 
State: string[2]; 

15 Zip code, AreaCode, Phone, Fax, Emafl: pchar; 

end; 



Subscriber = record 

AccountNo: integer, 
. Birthdate: Date; 

Se^ MaiitalStatus: Char, 
HouseholdSize: byte; 
Interests: array [0. 15] of integer, 
TopChoices, ChoiceCounts: array[0..15] of integer, 
ChargeLevek byte; 
DataRate: Integer, 
Capacity: Integer, 
«.v WeekDays: array[0. 6] of Compilation; 
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Advertisement = record 
ProgramlD: integer; 
AccountNo: integer;. 
DemographicMatch: functioned; 
DemographicWeight: byte; 
Earliest, Latest: datetime; 
Subscribers: integer, 
Repeats: byte; 
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The Accounts Table seen at 321in Fig. 4 is indexed by a key value AccountNo 
which is unique to each of its Account records. The fields of those records contain name, 
■nailing address, telephone, fax and emaU information for aU subscribers, advertisers and 
content providers in a single shared file. Aperspn or firm specified by a record in the 
Accounts Table could simultaneously be a subscriber, advertiser and a content provider, 
in which case the same AccountNo key value would appear in each of the three tables: 
Subscribers 313, Content_Pr6viders 315 and Advertisers 317. Prospective or inactive 
subscribers, content providers and advertisers may also be described by entries in the 
Accounts Table which are not referred to in any other tables. 

Additional information about each active subscriber is contained in the Subscriber 
record indexed by AccountNo (a key shared with the Accounts Table). The Subscriber 
record specifies personal information about the subscriber, including birth, date (from 
which age may be determined), sex, marital status, and household size, all of which may 
be of tise m better i»ele^ be brought 

to the attention of the subscriber. 

Each Subscriber record further includes two arrays of i^ 
subscriber's subject rnatter preferences. The Interests array contains 0 to 16 integers each 
indicating a subject matter category of interest to the subscriber, the integers having the 
same meaning and being take from the same category listing as the integers placed in the 
Program_Segment record's Subject array. These integers are placed in the Interests array 
in response to the subscriber's indication of subject matter preferences when the account 
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is established as indicated at 203 in Fig. 2 or at any time thereafter when the subscriber 
elects to modify the stated preferences at step 217 in Fig. 2. 

A second array of 16 integers called TopChoices is ah ordered list of the same 
subject matter integers; however, in this array the subject matter integers are listed in 
order of actual playing frequency as indicated by the parallel array of ChoiceCounts 
integers. For example, the subject matter integer 321 in TopChoices[3] and the count 18 
in ChoiceCounts[3] indicates that 18 selections had been played in the category 321 which 
was the fourth most-frequenuy played category. The ChoiceCounts array is modified 
whenever the usage log indicates that a selection in a particular category has beenplayed 
by that subscriber, As a consequence, the TopChoices and ChoiceCounts arrays provide 
an indication of the subscriber's interests as indicated by his or her actual use of the 
player.. 

The ChargeLevel field in the Subscriber record indicates the subscriber's 
willingness to accept the insertion of commercial messages into the programming in order 
to defray subscription costs. A ChargeLevel value of zero indicates that the subscriber 
desires to pay the minimum charge and correspondingly is willing to accept sufficient 
advertising content to achieve that goal. At the other extreme, a ChargeLevel value of 
255 indicates that the subscriber wishes to eliminate all commercial messages except those 
specifically requested. 

The DataRate field indicates the rate at which information can be downloaded to 
the subscriber over die available communicator!^ 

of the modem used by the subscriber). The DataRate field is rniuaUy established from 
information supplied by the subscriber when the account is established (at step 203 in Fig. 
2) but is thereafter altered to reflect acfoal averaged traii^ 
download operations. Similarly, the Capacity Vindicates me wrailabte 
space available for program data in the player store (seen at 109 in Fig. 1). This value is 
initially supplied by the subscriber during account initialization, automatically reduced 
whenever the utility programs executing oh the processor 105 detect less space available, 
andmiaea^wheneverme subscr^ 

when the utility programs detect that space is available and that additional space could be 
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beneficially utilized given the download time available and the subscriber's desired session 
lengths. ■ • ' * 

Desired session lengths are contained in seven records «ach of type CompUation 
as defined in the following record definition: 

Compilation = record 

Earliest, Latest: datetime; 
PlayMinutes, Longterm: Integer; 
end;. - 

Each Compilation record describes the download requirements for a specific day 
of the week and contains fields specifying the earliest and latest times of day when 
download can be begun, with the latest download time being at least a predetermined time 
in advance of the session start. In this regard, H should be noted that playback and 
download can occur concurrently, with the Schedule Table being downloaded first, the 
NewCatalog Table being downloaded second, program segments specified in the Schedule 
Table which have not previously been downloaded being transferred third (in the order of 
the expected presentation as stated in the Sequence Table), with program segments 
selected by the subscriber for nature sessions being downloaded last as download time 
permits. In accordance with the invention, it is desirable to download the equivalent of 
a foil session's programming in addition to me aurently schechded session programs s^ 
that, in the event of a temporary comnmmcationlinkorhoa 

nonetheless be available: In installations which utilize download information to a 
removable media cartridge or a transportable player which is then played back in an 
automobile or elsewhere, and hence disconnected from the data link to . the host, it will of 
course be necessary to complete the download prior to the disconnection, meaning that 
the Latest field, in the compilation record should be a time which is in advance of the 
earliest expected session start time by a duration equal to the maximum expected 
download time. Because the subscriber may wish to use difierert download timing on 
diflferent days of the week, a separate compilation record exists for each day. 
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The cojnpOation record further specifies the expected duration of the playback 
session for that day using the variable PlayMmutes, The variable Longterm indicates the 
maxunum duration in which extended play may be required. For example, a commuter 
who sometimes experiences long traffic delays on Mondays and Fridays may specify that 
an extra hour of. extended programming should be provided for those days. Such 
extended prograinmii^is preferabfy of non-time critical programming which can 
be stpred for future use as heeded by the player. 

Note thai the compilation records noted above are used by Ae server to optimize' 
the content of the recommended program schedule and not to initiate actual downloads 
tomeplayer. As coirt^lated by. the invention, Ae player imtiates the actual downloads 
bysendingdownloadrequeststotheserver. Nonetheless, the server can transmit tothe 
cfoatplayeranmdica^^ fo 

this way, the load imposed on the server can be spread over time to avoid delays. 

Program segments which are of interest to the user and which should be included 
in either the Schedule Table 307 or the Catalog Table 308 may be automatically Identified 
by the following mechanisms: . 

a. the subject matter codes (Interests, TorKJhoi^ 
givensuba^fbrwtomte^ 

being prepared may be compared with the subject matter coiitained in the 
Prognim.Segmemi^'sSTibject for each subjert category description and 
eaAmdividualiTOgnimoes^ Note that the ProgramJSegment record 
s. fe : 8 ^ectcategorydescr^^ 

an indication that a subscriber is interested m a part 

used to identify that category, any related category, and any program which 

specifies tiiat category in its Pre 

may be calculated to indicate the extern to wMch the ra^ 

mterestsmatchagiven 

high weighting values are assigned are placed m the Schedule Table if the 
usage log data does not indicate the subscriber has already played that 
; prograin, whereas the rem^ 

than a predetermined threshold are placed in the Catalog Table 30g. The 



36 



WO 99/43111 



PCT/IIS98/03444 



duration of the programs specified in the Schedule file 307 is governed by the 
scheduled. sessibii lengths, communications throughput, and client storage 
capacity values contained in the.DauRate, Capacity and WeekDays fields of 
the Subscriber record, 
b. The attributes of the subscriber (birthdate, sex, marital status, and household 
size) specified in the Subscriber record may be matched against the 
corresponding descriptions contained in the subject and program 
Program_Segment records (youngest, oldest, male, female, houselow, 
hpusehigh) to identify programs and categoriesof programs likely to be of 
interest to a subscriber having those attributes. An advertiser-supplied 
fiinction defining this relationship is specified by the DemographicMatch 
functioned field of the Advertiser record, as discussed below. 

a. The host server may advantageously use an optimization technique such 
as linear prograiiiming to complete the segment selection process. The 
optimizer will take into account the Subscriber's time constraints, cost 
constraints, and subject preferences. The time constraints used in the 
optimization are: the playing time available for the current day at the 
player, the download time available, the percentage of segments usually 
skipped by the Subscriber. The cost constraints are Subscriber 
ChargeLevel and the accumulated value of individual advertising 
segments. The -subject preferences are based on the user's expressly, stated 

„ . ... Interests and others inters inferred from the user's playing selections, as 
noted earlier. Bach segment resident in the database at the time of 
download is evaluated against the constraints and the optimizer thus 
chooses a set of segments which is best for ^ 

b. The weighting value computed for a segment in the database may also be 
advantageously varied in accordance with the age of the segment; that is, . 
segments will decline in value as they age with the rate of decline being 
depend on the Timeliness attribute stored in the Program s egment record . 
If the subscriber misses a download for a given day, the timeliness factor 
will allow the host server to compensate for the lost listening opportunity 
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by adding articles from prior days which are still of interest to the 
Subscriber. 



Targeted Advertising 

In order to identify and insert advertising program segments into the Schedule 
Table 307, the preferred embodiment of the invention utilizes additional information which 
describes each advertisement to be placed before subscribers. This information is placed 
in an Advertisement record having the structure defined earlier and held in the 
AdvertisementsTable311. The ProgramlD field of the Advertisement record identifies 
a Program_Segment record (described earlier) which describes the content of the 
advertisement itself The remainder of the Advertisement record contains additional 
information used to control the manner in which the identified advertising program 
segment is selected for insertion into the programming supplied to subscribers. 

TheAccc>unuNbfieldoftheA>^ 
the advertisement which is typically the same as, but not necessarily the same as, the entity 
specified mtheProviderlD field of tteProgram^Segment record for advertising segment. 
, TteSubjectsandln^ (specified 
bythe^grammfield^ 

for subscribers to indicate their interest and may be used to produce a numerical vahie 
InteresuMatch indicative of ti^ 

to the interests of a particular subscriber. The following algorithm, expressed as a 
.&nction in Pascal, returns an integer value, which may be employed to derive the 
IhteresuMateh value indicating the degree to which any program segment matches the 
interests' of a given subscriber: 



fin^onlhtereslMatd^SR: subscriber, PSR: program_segment): integer, 
25 : var I: integer, 

. InterestCount: integer, 
ChciceCount: integer, 
begin . 

InterestCount :=0; 
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ChoiceCount:=0; 
forl:=0tol5do 
if PSR.subjects[I) > 0 then 
, forj:=Oto 15 do. 
begin 

if SRJnterestsB] - PSRSubjects[I} then 

inc(IriterestCount, PSR.Importance[I]); 
if SR.TopChoicesO] = PSR.Subjects[I] then 

: inc(ChoiceCounts,(20-j)*PSR.Importance|T|); 

end 
• else break; 

retumflnterestCount + (ChoiceCounts div 10); 
end; { InterestMatch function } 

The foregoing function identifies all of the Subjects codes specified by the 
program_segment record for a program segment (including a segment specified the 
ProgramID value of the Advertisement record for that advertisement) which also match 
a subject matter code in which the subscriber described by the Subscriber record SRhas 
expressly stated an interest, or has shown an interest base on programs actually played. 
In each case where a match was found, the Interestjvfatch value is increased by an 
amount related to both the weight given to the category in advertising program's 
Importance array and the level of interest indicated for the subscriber. Note the 
InterestMatch function described above can be used to generate a numerical indication of 
the degree to which a given subscriber may have an interest in any program segment, 
whether that segment contains advertising, entertainnient, news, or in the 

case of advertising program segment however, the Subject and Importance values are 
assigned by the advertiser in order to define the interests held by .target subscriber to 
whom the advertiser wished to direct the advertisement. 

haddition to the InterestMatch value determined above, weight may be given to 
the subscriber's personal characteristics using a similar weighting function specified th the 
functioned DemographicMatch which, like interest match, returns a value based on an 
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advertiser specifed relatiionship based on the subscriber's personal characteristics (age, 
sex, marital status, size of household, etc.) as previously noted. The value 
DemographicWeight may be used to specify the relative importance of demographic 
values derived by the the DemographicMatch function and the value returned by 
InterestMatch. 

All advertisements scheduled for a given subscriber may then be prioritized based 
on the resulting calculated weight assigned to each advertisement by matching algorithms 
which compare the characteristics of the subscriber with the makeup of the target 
audience defined fay the fields of the Advertisement record These advertisements are then 
preferably inserted into the programming Sequence with the advertisement having the 
highest weight bring scheduled to occur first in the sequence, thereby insuring that the 
best fitting advertisements are included in the programming and most likely to be played 
by the subscriber. 

Controlling the Quantity of Advertising Delivered 

The rate at winch advertising is actually inserted by the player is controlled by the 
OiargeLevel value in the Subscriber record for each subscriber. The Ch&rgeLevel value 
(a number from 0-255) indicates the rate at which a subscriber is willing to accept 
advertisements. An advertisement duration count variable (not shown) maintained by the 
player 103 accumulates the total duration of actually played advertising while a program 
duration count variable accumulates the total duration of actually played programming. 
An integer division of these to duration count values indicates the proportion of time 
bang devoted to advertising. If this proportion fills below a threshold value determined 
bythevalueofOiatgeUvd, additional advertising is inserted between program segments 
until the desired proportion is again readied. In this way, advertising skipped by a 
subscriber will be replaced later by different advertising to yield the proper proportion of 
programming to advertising, thereby achieving the subscription charge rate requested by 
the user. , 

The Schedule 307 downloaded to the player, and the associated programming, 
announcement and advertising segments sufficient to provide a complete program 
sequence with adequate advertising to meet the preference of the subscriber, creates total 
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program content longer than the expected playing time indicated by the PlayMinutes 
variable of the days Compilation record. As a consequence, the player builds a collection 
of program and advertising segments which can be played in the future and need not be 
downloaded. Downloading of actual program segments therefore preferably occurs at the 
request of the player which scans the Schedule for program and advertising segments not 
already available and issues a request for the needed segments using the URLs contained 
in the players catalog of Program_Segment records. In addition, as noted earlier, the 
subscriber has the opportunity to review the local catalog for particular program segments 
of interest which can be placed in the next day's schedule (and downloaded then at the 
request of the player if not already resident). The catalog of available items is 
supplemented by theNewCatalog Table items downloaded from the server as library items 
are identified whose makeup matches that of the subscriber and should be included, either 
iinmediately in the days Schedule Table, or made available by inclusion in the downloaded 
NewCatalog Table alone. 



IS Accounting Functions 

The preferred embodiment of the invention processes the usage log data created 
during the playback session as described in connection with Fig. 3 to produce a variety of 
accounting and analysis reports and billing functions 

Each advertising, announcement and program segment played on the player 
creates a UsageRecord stored as an record in the Usage Log Tabletaving the following 
content: . 

UsageRecord = record 

Subscriber: integer; . 
ProgramID: integer, 
25 Start datetime; 

Volume: Integer; . 
PiayingSpeed: Integer, 

end; 
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The Subscriber field contains the AccountNo of the subscriber which used the 
program segment, and the program segment itself is identified by the PrograrnID field 
If the value ofProgramID is negative, the record indicates a failed hyperlink attempt and 
the PrograrnID is posted to the Requested Table 301 so that the formerly missing program 
segmert^^ IntheUsageRecord the . 

Start field contains the starting time of day (to the nearest second), the Volume field 
contains a value indicating the level at which the volume was played, and the 
PbyiagSpeed field contains a value indicating the playing speed. A negative playing speed 
value may be used to indicate that the player was placed in the "play highlights" mode so 
that onh/ highlight passages were being played! 

Asnoted eariier, eachUsageRecord is proved to modify me Subscriber record 
field TopChoices by first building an ordered list of subject matter categories and the 
corresponding counts of the number of times each category was played in the session 
described by the Usage Log Table. These counts are then used to increase the existing 
Choice Counts for the subject matter codes indicated in the TopChoices array, and the 
TopChoicea and ChoiceCounts arrays are then jointly resorted into order by descending 
"omberofplays. To insure that subject matter categories recently used are allowed entry 
intothelist, theloweafiveoMentrfc are discarded each timeif necessary to make room 
for the five most frequently played categories in the current usage log which were not 
alreadyontnelist The TopChoices mvm>oc^c^ m9di ^ 1 ^ ml 
of subscriber subject matter preferences which is continuously modified automatically 
without requiring attention from the subscriber. 

Subscriber billing is based on the accumulated amoum of programnung^a^ 
Idayedby the subscriber wim^ 

subscriber. To accomplish this, a detailed baling Iri^ry can be W 
usage log which indicates the programs heard, the duration of each, and the cost (or 
credit) attributable to mat program segment, the TuneRate value specified in the 
Program_Segment record for each item specified in the UsageRecord's PrograrnID is 
multiplied times the segment duration (determined by subtracting the start time of the 
segme* from Ae start t^ ^ 

TimeRate is a signed integer, with negative values being indicative of credits (for 
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advertising) and positive values being indicathre of charges for prograinming. Notethat 
each program segment and advertising segment can have a different rate, allowing the 
system to accommodate charging rates that reflect different prograinming costs. 

Such costs frequently are affected by the royalty rates charged by content 
provMeraasweUasAeextertto^ In accordance 

with the invention, each UsageRecdrd may also be posted into the ContentProviders 
Table315 which maintains royalty payment records tor air^ 
As in the case of subscriber billing, the processing of UsageRecords allows the 
embodiment shown in Fig. 4 to provide detailed information to content providers, 
identifyingthe extent each provided program segmart was acta^ Content 
providers can also be provided with demographic statistics identifying the characteristics 
of the subscribers who chose to play the content provided, as well as an identification of 
the extent to which program segments were skipped while in progress, tending to identify 
programs which were had continuing appeal during the session and those that did not. 

Similarly, advertisers can obtain detailed billfog record 
extent to which advertising was actually presented, and paying only for advertising known 
to have been effectively dehvered. In addition, demographic data can be provided to 
advertisers indicating the makeup of persons who played the advertising, as well as the 
demographic characteristics of those who did not, in order to better target fouire 
adveitising. 

Finally, the UsageRecords are processed to post use data into the Programs Table, 
moving the Plays and JptalTime fields of the Program_Segment records to reflect the 
extent to wWch programming materials are actually presented. This information, as well 
as the demographic statistical information indicating which classes of customers are 
listeningtowMchcla^ 

offered prograrnming which best fits the needs of the conm^ 

Program Format and Organization 

The programs which reside in the program database 303 seen in Fig. 4 are 
preferably foimatted in accordance wimasta^ard stroctureto 
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sequence of program segments defined by the selections file 35 1, and to make it possible 
to perform jumps to different predetermined logons in the program sequence. 

As previously noted, the program database 303 may include, for a given program 
segment, bomarecorded ^° narration 

transcript alone which can be converted into a spoken narrative by speech synthesis 
WMemesenarrative.inu^ 

to selectively access individual program segments by organizing the overall program 
compilation into a hierarchical structure in which.- - , 
- 1. ^"^^er.thepiDgnro 

are described in a catalog and associated with descriptors of various kinds 
aUowingttecb^ 

subscriber, bom through express selections made by the subscriber and by 
selections (or suggestions) made automaticauy by matching the subscribers 
faiown prefer^ 

programs segments, as previously described. 

2. The resulting program compilation is then divided into components each 
havii«abeghmin&^ 

by a dynamic selection mechanism which is operative during the hstening 



session. 

3. 



Agivenprogram segment <i.e., an entity described in the program catalog and 
selected automatically or expressly by the user as being of interest as 

combined with other related program 




, — — f « w^icu. 

segments to form a sequence of associated segments here called a "subject, 
forming a subsection of the overall conipilation. A "subject" coUectionof 
program segments may (but need not) directly correspond to the named 
subject matter categories utilized to specify subscriber's preferences as noted 
earlier. A "subject" collection begins with or is preceded in the scheduled 
program sequence by a spoken announcement of the subject, giving the user 
the opportunity to slop inunedately to the next subject, thereby skipping all 
of the program segments comprising that subject 
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As a consequence, by the simple expedient of skipping from subject 
announcement to subject announcement, a user can locate a particular subject 
of interest. For example, if a given program compilation as defined by the 
Selections file (having the format illustrated at 35 1 m Fig. 5) contains one hour. 

5 of prograrnnung divided into 8 different subjects collections, the user can 

quickly locate a subject of interest by skipping from subject announcement to 
subject announcement until a subject of interest is announced, at which time 
the Player is allowed to proceed to the next level in the hierarchy, a "topic" 
announcement for the first program segment in that subject collection. 

10 4. Each program segment begins whh a "topic" announcement which consists of 

a bri< summary description ofthe content of the program segment to follow. 
Again, at this level, if the user upon hearing the topic announcement elects to 
skip that program segment, the player automaticaUy advances to the entry 
point preceding the next topic announcement. In this way, within a given 

ls subject, the user can skip from topic to topic to select only the program 

segments of interest. 

5, Following the topic announcement, if the program segment consists of 
narrative text, such as a news program, the narrative is presented in a 

; sequence of paragraphs, with the first paragraph providing an overview 

summary ofthe content of the program segment (topic) and the succeeding 
paragraphs providing increasing levels of detail. The narrative is thus 
; presented in a fashion not unlike that followed in news stories written by 
journalists fipr print publication, but with more dependable rigor, recognizing 
that the listener presented with a one-dimensional audio presentation must 
necessarily depend on the consistent adherence to me subject, topi<^ sunirnary 
paragraph, and increasing detail sequence to substitute for the random access 
provided by two-dimensional presentation of headlined newsprint articles. 

6. Finally, within paragraphs, the sentences should be carefully organized with 
leading topic semences, agam giving the listener a preview of wliat is corning 

3° next in the sequence to enable that material to be skipped if it is hot of interest. 
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By way of example, a program compilation for a given subscriber might 
illustratively consist of seven subjects: world news, national news, local news, computer 
trade news, email and voice mail messages, country music classical music, and the listener 
may skip from subject announcement to subject announcement to readily locate the 
beginning of any one of the six subjects. The four "news" subjects each consist of a 
collection of structured program segments, each of which begins with a subject 
announcement, again alio wing the user to skip from subject to subject, listening to only 
those which are found to be of interest. 

Smularly, the music selections <>pics") within each of the two music subjects, 
"country music*' and "ctasacalniusV identifying 
the musical selection which follows, allowing the user to quickly skip from announcement 
to announcement until a desired selection is found. Because many listeners prefer music 
without announcements, the subscriber may request that the announcements be suppressed, 
during continuous play and/or that the beginning of each musical segment be played 
instead of identifying announcements when the musical collection is being "skimmed" to 
locate the next selection to be played. To simplify the player controls, the subscriber is 
I>referablyaelects the extent to which narratrvenmsic identification aimou^ 
be played at step 21 1 seen in Fig. 2, at the same time me user is given the opportunity to 
edit the downloaded program sequence. 

20 Flay Highlights Mode 

.. . To fiirther facilitate rapid skiinming, the player may be adapted to support 
playbackmwhatwheretennedtte Just as a student often uses 

a marker to MgnHghtimiwrta^ 

narrative may be tagged as highlights such that, when the user places the player in a "play 
WgbJights" irode, the player autoin^ 
passage, greath/ increasing the speed of presentatfon, butaUowing meuserto rev^ 
normally play mode whenever a highlighted passage attracts the users interest for more 
detail 

Hghlighted passages may be advantageousfy identified by irieaM 
30 relative byte locations Onteger ofBets from me beginiiing of the program segment) which 
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foim part of the selections file 351 and which specify the start and end of each highlighted 
passage. The player, when placed in.the "play highlights" mode, then plays only those 
passages identified as highlighted portions of the program segment file. 

Hyperlink Jumps 

In addition, the structured program files may advantageously contain, where 
appropriate, "hyperlink" passages, which may take the form of announced cross references 
to other materials, or sentences or phrases which describe related information contained 
- elsewhere in the download compilation but which do not Mow immediately in the 
sequence. In order to alert the listener to the feet that a sentence or passage is a hyperlink 
to other information which is out of the normal playback sequence, an audible cue may 
advantageously proceed, accompany, or immediately fbUow the passage in the normal 
playback which identifies the character of the hyperlinked material. Using the 
terminology typically employed to described hypertext, the normal programming 
sequence includes "anchor" passages which are identified by an audible cue signal of some 
type and are further associated with a reference to hyperlinked material to which the 
playback may jump upon the listener's request. Hyperlinked material, like all other 
programming, is advantageously preceded wito a topic description and, if the h^ 
material is a narrative, it should begin with a summary paragraph, Mowed by increasing 
detail. 

A hyperlink may be directed to a program segment which is not present in the 
current selections list. In that case, the link variable contains a negative number to. 
distinguish it from references to a particular SdectionJRecord, and is interpreted as the 
negative of aPfogramID number, Iftherefiaenced Program© fa available in the player's 
mass storage system, it may be fetched an played and, upon its conclusion, an automatic 
return is made to the original sequence. If the referenced ProgramID does not refer to a 
locally stored record, the listener is informed that it is currently unavailable, but will be 
included in the next download for the next session. 

In addhjon to having means for accepting a user command to execute a jump to 
the hypertext material, the player also advantageously includes a mechanism (special key 
or voice command response) which, when activated, causes a "return" to be made to the 



i 



WO " /43m ; PCT/US98/03444 

playing sequence at the point of the original anchor from which, the hyperlink was 

performed. In this way, a listener may listen, to as much or as little of the linked 

mformation as desired, retaining the ability to return to the original. Just as computer 

subroutines may be nested by saving the return addresses of a calling instruction in a stack 

mechanism, ahyp^ 

yvimtheUstenerretaiiung^ 

playing sequence at the point of the first hyperlink call 

To control subject and topic skipping, as well as hyperlink jumps, the selections 
file seen generally at 301 inFig. 4prefi^h'takesthefennof asequence of records, each 
having the structure defined by the following Pascal record definition: 

type Selection_Record = record 
LocType: Char, 
Location: Integer; 

end; 

where LocType is .a single byte character having the vahies and im 



following table: 




LficTjrpfi 


Meaning 




Subject Announcement 




Topic Announcement 


«p» » p n 


Programming content segment 




Advertising segment 


"(yVg* 


Glue (announcement) segment 




Highlight start offset 


"ET 


Highlight end offset 


-A" 


Anchor start offset 


"M* ' 


Bookmarked anchor start 


"B n 


Anchor end offset 


"L" 


Linked segment 




Rewind to identified location 




Image identification 




Image display start oflset 



48 



WO 99/43111 



PCT/US98/03444 



"K" Image display end offset 

"C" Accept comment 

"V" Accept value designation 

"X" Accept list termination 

T Accept "Yes" /"No" 



As seen in the table, highlight passages are specified by two SdectiohJUcords, 
an "H" marking the beginning and an "E" record marking the end of the highlight passage. 
The Location field in each record contains the byte offset from the begbning.of the 
current program segment whose identity is specified by the last preceding "P" 
SelectionRecord which contains theProgramlD of the program segment in which the 
highlight passage occurs. "Q" advertising segments and « ; G» announcements segments 
behave like regular programming content segments, but are uniquely identified to enable 
the player to skip over, or skip to, advertising and glue segments when appropriate. In 
the "play highlights" mode, the player scans the selections file and plays the program 
segments for each subject and topic announcements but plays only those portions of an 
identified program segment which are specified as highlight passages or as anchor 
passages for hyperlinks.. 

It is desirable to further provide a mechanism for subdividing narrative 
programming segments into subparts (eig. paragraphs). Lowercase LocType values "s", 
y, V and "g" are used to subdivide subjects, topics, programming, advertising and 
ghie segments respectively. The lowercase Loctype records provide the markers needed 
to implement subdivision skipping, as previously discussed, to enable forward and 
backward navigation within longer program segments, and further provides passage 
identifiers which may be used to better synchronize the audio and visual transcript 
presentation of longer passages. 

An *T Sdection_Record contains an integer identification of an image file which 
is downloaded and stored using a filename found in an image filename table indexed by 
the image identification number. This indirect access to the image files eliminates the 
necessity of storing the fileramesmemselves in the selections file 351. The T' image file 
identification records, immediately precede a T record which specifies the offset location 
from the start of the compressed audio file where the image display begins. In normal 
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"slide show" presentations, the current image display continues until the position indicated 
byasubsequent^^ ^ 

"K» record type is provided to indicate the position at which the current image display is 
turned off for those instances when it is desired to suppress the image display entirely. 

Each anchor passage for a hyperlink is specified by three selection records: an "A" 
record indicating the start of the anchor passage, an «B» record indicating the end of the 
anchor passage, and a «L» record containing the offset location within the selection file 
to which a jump is made if the user requests * jump to the hyperlinked material. 

As-discussed in more detail later in connection wim Fig. 7 of me drawings,^ 
position and identification of highlighted passages, hypertext links and synchronized 
images may be conveniently expressed using conventional hypertext markup language to 
tag the text of the narrative to being presented in the interactive multimedia format 
contemplated by this aspect of the invention. 

The start ofbookmarked passages am iden^ 
"M," Mowed by a «B» record to identify the end of the bookmarked passage If a voice 
annotation is added, the player places it in its own program segment which is identified 
wimanegintvePrograrnlDmmefonowing The presence of the annotation 

may then be made known to the listener during subsequent playback of the marked 
passage by means of a distinctive audible cue, and the annotation may then be listened to 
mthesanrcfaslrionasanyot^ Note that bookmarked 

passages and annotations are noted both in the usage log file, as discussed earlier in 
connection wit* Fig.3 at 280 and 281; but also their presence is also recorded in the 
SetectionsffleSSlVins^ ^ 
it possible to hnmediatdy replay annotations or return to replay bookmarked passages. 

Annotations differ from "comments" like an annotation, a comment is also 
stored in its own program segment, but a comment operates as a public of private 
messagegeneratedby theuserahd commumcated publicly or privately to (1) ^designated 
spedal interest group, (2) the originator of a program segment, which may be the author 
ofeaifiercainn^^ 

anotefbrfi^referaice: wTiflebomcoinmeitts and annotations nuyb^ . 
request of the user at any point during a playing program segment using the 'Accept" 
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command (see 263-264 in Fig. 3), the user may be prompted by a pre-recorded request 
for a comment, or other user input, with the prompting request being placed at any point 
in a playing program segment, typically after an audio prompt which explains the nature 
of the information being requested. 

Requests for information from the user preferably take one of three forms which 
are implemented by the records in the schedule file identified by the LocType codes "C" 
.'V.'TT and"^. 

A "C" record causes the player to temporarily pause the playback and record a 
voice response from the user which may be ajfchrarih/ long and which is uploaded to the 
server 101 to form a new program segment in the manner to be described under the 
heading "Comment Handling. 

A "Y" record pauses the playback and awaits a ^Yes* or W response from the 
user which is then recorded in the usage log. The yes/no. response request allows a 
program provider to obtain response data from subscribers. 

When simple "yes" /«no n answers are inadequate, a series of «V records may be 
used to identify a set of prompt values from which the user may select, with the end of the 
list being indicated by a "X" record. The narrative of a program segment might, for 
example, proceed as follows: " We would like to know which of the following four ice 
cream flavors is your favorite. Say the word "YES" promptly when your fevorite is 
mentioned. Y chocolate Y vanilla Y pistachio Y peach E". In the txample, the Y 
characters indicate the position of the start of each prompted choice and the E character 
indicates the end. If no affirmative voice response has been accepted by the time in the 
playback the position indicated by the £ selection record, the player returns to the 
positions indicated by first of the series of Y records to repeat the choices. Whenavafid 
response is received, a response value is written into the usage log indicating the ordinal 
position of the selected response: Given the protnpts above, for exaimde,ifthe user says 
"YES" after the "chocolate" prompt, the response value 1 is written to the usage log, if 
the user selects 'vanilla' a 2 is written, and so on. 
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The Selections File 

** . .«**<. * SMmto4 fc ^ ^ 351 ~ 

of 36 o * 353 J™^ 

W-d *** .„ dpliyttle ^ . ^ by ^ ^ 

selection, can be readily found. °™m 
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the next "S" subject or "T ! topic record, skipping the remainder of the program selection. 
Thus, the user can quickly resume skimming on the subject and topic level at any time. 

The user may also issue a "Back" command at any time. Back commands work 
like Skip commands at the subdivision, subject and topic level. If a Back command is 
issued when a subject is being played, the player scans backward to the previous subject 
announcement, which is then played. If the user issues a back command when a topic 
announcement is being played, the player scans backward to find the previous subject or 
topic announcement, which is then played. If the player issues a Back command during 
the playing of a programming segment, the player returns to the beginning of the prior 
subdivision (if any) or the prior topic announcement for the current program segment, 
thus enabling the user to easily "replay** a current segment from the beginning if desired. 
As in the case of forward skip commands (SKIP TOPIC and a SKIP SUBJECT), BACK 
TOPIC and BACK SUBJECT commands can be made available to.the user such that 
backward navigation from subdivision to subdivision occurs using BACK TOPIC whereas 
the issuance of a BACK SUBJECT command always returns the playback point to the 
beginning of the prior subject matter description. 

The manner in which a "Back" command is handled as described above is subject 
on additional variation: The position at which each skip forward command is issued may 
be advantageously saved so that, upon the issuance of a subsequent Back command, the 
user may return to the position at which the skip forward position was issued. This allows 
the user, for example, to slop forward to listen to the nest program announcement, and 
then use the Back command to return to the point from which the skip forward command 
was issued. These position indications may be saved as markers in a bi-directional list, 
allowing the user to skip forward or backward to any position from which a prior jump 
was made. 

When the player is first activated, QiirenfPhy is set to 1 to begin play whh the 
first topic announcement specified by the Program© 357. The end of the selections file 
351 is marked with an "R" Selectioh_Record 380 which contains the location value 1. 
When the player encounters this record, it resets the CurrentPlay register to 1, and the 
playing sequence begins again. This arrangement creates, in effect, an endless loop, 
allowing the user to skip forward in circular feshion through the entire program selection 
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to locate desii^ progranuning, regardless of where the CurrentPlay register is set. When 
the player is given a farther back command after the beginning of the file is reached, the 
backward scanning process finds the record 382, another "R" rewind record which 
contains the location of the last "S M subject Sdection.Record. In this way, the selection 
5 file 351 behaves as a bi-directional endless loop. 

Ityperlinks are implemented by means of anchor passage identifiers] the "A" and 
°B" Selection records which respectively identify the anchor passage, and a IT link 
identifier which holds the location of a subject, topic or highlight SelectionRecord. The 
"A" and "B" selection records enable the player to add an audio cue (such as a tons, low- 

10 level chime, or the Hke) to me beginning, end, or during any passage in any program 
selection Whenever the user issues a "Go" command (seen at 265 inRg. 3), theplayer 
will execute a hyperlink jump to the location indicated by the last "L" record in the 
selection file. When the jump is made, the location in the "L» record is inserted into the 
GmentPlay register 353 after the previous contents of me Currer^ 

15 in (pushed into) a*ero4>asedstack390atth^ 

of a StackPtr register 392, which is then incremented. Whenever the listener issues a 

"Return" conimand, the p 

thestack 390 and retimed to the Gin^ 

is decremented, A "Return'* command issued when StackPtr = jpero indicating an empty 
20 stack) produces no effect. 

The hyperlink capability described above may be used to implement a program 
memi of the type de^ed earlier m 

may be included in the program compilation which includes a series of spoken descriptions 

of subjects or topics, each description being the aiw*or portionpf a hyperli^ tothe 
25 corresponding subject or topic. 

Although hyperlinks to subjects and topics are typical, it should be noted that the 

arrangement shown in Kg. 5 can be used to link any passage to the beginning or end of 

any bJghUghted passage or to the begtanm^ 

placingthesetecfion^ 
30 that link. 
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. In its preferred form, the individual program segments are stored in a random 
access mass storage system permitting program segments to be physically stored in an 
order unrelated to the actual dynamic sequence in which those segments are played. 
Forward, and backward skimming, highlight playing, and hypertext jumps can accordingly 
be implemented without any noticeable delay being apparent to the user, unlike the delays 
which are experienced in forward and rewind operations on a physical tape player, or even 
the briefer delays experienced upon selecting a different track of a compact disk music 
album. 

As contemplated by the invention, the -integration of structured audio 
announcements and content, as will as. cross-referencing and indexing information in the 
audio program compilation, allows the player to be much more interactive than a simple 
tape recorder. The user has the ability to browse and skip through the audio program in 
a very active way, without any. requirement to look at a visible display of the program 
content. The ability to navigate the program using only audio prompts and/or small 
number of buttons for a user interface make the playback system which utilizes these 
features of the invention particularly attractive for use by automobile drivers, who can 
.select their program content much more effectively and with less drive distraction than 
currently possible with a conventional automobile radio, tape or CD player. 

Program Production 

Eg. 6 shows the method followed to produce program content which is structured 
in accordance with the invention to facilitate interactive s program selection. The first step 
in program production is to build a structured database of 'articles' which are candidates 
for inclusion in individual subscriber compilations. 

The authoring system seen in Fig. 6 scans a wide range of data sources 401 for 
potential content as indicated at 403. Examples of data sources might be news service 
wire feeds or newsgroups on the Internet. The authoring system subdivides the accessed 
program datainto program segments (topics) and indexes each segment by subject area 
at 405. In the case of text data, this indexing may be done automatically by parsing the 
text into words, and building a conventional inverted file word index to the program 
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segments. In the case of audio . programming, a text transcript may be prepared using 
conventional speech recognition mechanisms to for a transcript, and the transcript may 
then be indexed by the terms used. Ahematively, human indexers may produce 
descriptive words and phrases to (tocter^ the content of a program segment, and these 
descriptors may be used to index those segments. 
Afterttemdexinglm 

the each program segment's index data at 407 with system wide selection criteria in a 
svstemdatabase409to^ 

those programs which of potential relevance to one or more of the established subject 
matter categories ofR^ Accordingly, the system filter database 409 may 

take the form of a set of words (descriptors) of known relevance associated with each of 
the subject matter categories in the catalog/ The comparison function.* 407 scans the 
words in each candidate program segments to form a weighting value indicating the 
ifca^C*^ Program segments 

whose content produces a high weighting value with respect to any category are 
automatically associated with that category and retained for further processing as 
indicated at 408, while program segments producing, no weighting values greater than a 
predetermined minimum may be completely discarded at this stage, as indicated at 41 1, 
since their content does not indicate a sufficient likelihood of being of interest to a 
sufficient number of subscribers. Marginal program segments may be returned to the 
sourcelibrary401 forpossible later use m me evem mat user preference 

sl^articte which p 
Kg. 6. Asi^eaJier,^ 

a transcript for those segments which consist, in their original form, of voice narration. 
This step may be automated using speech recognition or manually by keyboarding to 



As indicated at 425, when the original material con*^ 
form, ahuinanreviewer verifiesthat the program content is in fact relevant to the subject 
mates^oegori*^ ^ ^ 

adds .additional subject matter categories that nuy have, been overiooked 

process. As a result of this automated and human-verified classification process, each 
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program segment is associated with one or more subject matter categories which are 
encoded into a standard form in the Subjects array of the Program^ Segment record 
described earlier in connection with Fig. 4. These subject codes are farther assigned an 
importance value in the Importance array (which is parallel to the Subjects array) by the 
human author. Note that the order in which subjects codes are placed in the Subjects 
array may be used to indicate the relative relevance of the subjects to the program 
segment; that is, the most relevant subject is identified in Subjects[0], the next most 
relevant subject is identified in Subjeets[l], and so on. Each program is typically placed 
in the output sequence in accordance with the code at Subject[Oj, the subject to which the" 
program segment is most relevant.' 

In addition, the human review may compose , a narrative cross referencing 
description of some or all of the program segments which were secondarily relevant to a 
given category, that is, program segments which were most relevant to another category 
but also relevant to the given category. This cross^eferencing description may 
advantageously utilize the hyperlink capability discussed earlier such that, when the user 
is listening to the description of any related program segment, that related segment may 
be listened to simply by issuing a Go command to jump to the linked article, and later 
issuing a Return command to resume the playback at the original point. 

The body of the program segment is then organized by the human reviewer at 
steps 43 1, 433, and 435 seen in Fig. 6 to create an output program segment having the 
desired structure consisting of 

(1) a topic statoiuint which is packaged in a separate program segment, 

(2) a leading summary paragraph, 

(3) farther cordent organized into paragraphs of maeasing levels of detail, in 
which all unnecessary detail is excluded (that is, longer topics are digested 
into shorter, overview topics, with the full version being made available in 
an alternative, unabridged form which is also made available to the 
listener), 

(4) adding highlight identulcation to key terms and phrases, and 

(5) addiiuj cross-referencing hyperlinks, with added explanatory anchor text 
if necessary. 
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When the original program segment is a news article or the like which was made 
availablemte*fonn^ 

the text, with the conversion to audio being performed by a human announcer or by 
speechsyntfo^after^ 

VW^mymdmm^im^pn^nMitin, andthen,* 
435, add highlighting and hyperlink tags (which take the form of imbedded flags of 0* 
typeusedmHypertextMario^ 

fig. 7). K^lo&itoV^lal^i^to^^r^ agiveil 
subjec^Hisdesirablethatthetopicand^ 

^^pHk^toUmgrpn^*^ In addmoi, the playing time is 
recorded in the Program_Segment record for that segment in the field named "Duration" 
asnotedearlier. A human announcer then reads the structured text, or it is alternatively 
converts into an audio program segment by speech synthesis, as indicated at 435. 

If desired, the user may request the player to periodica^ 
announcement, The user may set a playback m^v^htobk^dMto 
duranonbetweentimeofdayann^^ 

the last announcement time is ^rded. ^ , h ^ ^ 

program segments, the last announcement time is subtracted fiom the current time and, 

tftheiesuhexceeds^ 

is issued. 

In addition, at the user's option, the piayer may also periodically announce the 
duration of the flayed portion of the tob* <^ ilm to* * *p mf* 
programs in order to play others when the actual Usteningtime available is less than the 
time available to play the entire remaming program 

.. The Pky*mayfc For 
example, a program session may ton&ioiwiDd&'tontovBtm^ 
fimctioa at a particular time, such as listening to a scheduled radio broadcast 
Alternatively, the player may be programmed to play identified segments at a particular 
tnneofday, or at a paiticuUv time relative to 
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minutes after the session begins regardless, of what has been.played before or where the 
player is in the sequence). These programmed interruptions are preferably performed as 
automatic hyperlink, enabling the user to return to the regularly scheduled but interrupted 
programming simply be issuing a "return" command. 

It should be noted that program segments may omit the "original" audio file 
entirely. Instead, the audio may 

with tag to speechconversion of the tagged highlighted .nateri^ 

The text-to-speech technology might be especially useful for specialized subject areas, 

.such as weather reports, sports scores, or stock market quotes, or other primarity 

infbrmationai articles where the content is significantly more impc^ than the form of 
speech. 

• The availability of a collateral text file makes it possible to perform scanning 
operations to "find" particular words and phrases in the presentation, and perform a jump 
to that position in the file. Thus, the user may request the player to locate and play the 
next program selection in the sequence to contain the word "patent" and the player, in 
response to that request, performs a serial search through the transcript text associated 
with each program segment until the requested word is found, an a jump then executed 
to resume play at that location. 

Using conventional text indexing techniques, the transcript files of the programs 
apecified on the current program schedule, as well as the transcript files of other locally 
stored programming, may accessed by means of an inverted file in which each significant 
word inthe playable library is assodatedwim the an mdexmg record for eaA 
of that word, the record containing program segment identifier for the program segment 
including the word and the offsets) within that segment where the word occurs. The 
availability of that inverted file allows the player to immediately inform the user of the 
number of time the term occurs to avoid feuhless searches as well as searches which find 
too much, without actually scanning the transcripts. The availability of the program 
ia^*peniihsthepl^ 
afongwifcarecn^onoffe 
"Thetem'cdlular'occursTtiinesm 



59 



WO 99/43111 

PCT/US98/03444 

For e*^ . ^ ^ » y . ^ ^ • ^ 

amnectionwithFig.7. -*™»n raow m 
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mode facilitates the rapid review of longer, presentations by focusing only the central 
points presented while allowing more detail to be readily accessed if desired. 

When a given program segment contains recorded drigiiial audio, such the newly 
recorded narration of a human reader or an audio recording of a broadcast radio program, 
the file of selection records to be associated with that audio recording file is created by a 
human editor who utilizes suitable audio monitoring and editing equipment to listen to the 
playback of the audio playback file and identify the byte location within that audio file 
where highUght and anchor passages as well as response prompts which seek usfer input 
begin and end. h addition fi>rnyperl^^ 

identification of the cross-referenced material by spedrying the symbolic name of another 
selection record associated with the same or a different program segment to which control 
is to be passed if the hyperlink is executed by the user. A crucial step in the production of 
each segment is the association of byte locations in the audio stream with the records in 
the selection file; This association may be done by a human technician or by automatic 
methods. 

A technician would use a computer with suitable audio playback capabilities and 
software to play the audio stream and to simultaneously display the transcript if it is 
available. The software which plays the audio generates a new record in the segment file 
which contains the current byte location within an audio file whenever the human editor 
pressedakey. The significance of a byte location n»y be imficated by pressir« a selected 
oneof aplurafcyofkeys. For example, the technidaif could generate Subject and Topic 
records with the correct byte offset simply by pressirig.the "S "or "T" keys at the right 
rrtoira*wru>Iist^ The software could automatically generate 

the synchronizing segment record and proiimt the techrudm ^ 
thus identified with a corresponding location in the displayed transcript using a mouse or 
omerpositionalidentifi<^onmeans. VVhen no trawcnpt is available, me opem^ 
be prompted to enter a topic or subject d^crir^on via me keyboard. 

The process of associating of audio location wim segmem records process could 
be automated adding additional software to the technicians editing computer. For 
example, as indicated at 437, speech recognition technology may be employed to 
automatically identify when the live speaker changed in an audio stream . The monitoring 
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Location field in "L" Selection_Records. As discussed previously, these offset values are 
either positive values specifying the location within the Selections file of the 
Selection_Records which identifies the link target, or negative Program© values which 
identify program segments not specified by the current Selections file as being part of the 
current program session content. 

Comment Handling 

As previously discussed in connection with Figs. 3 and 5, the apparatus 
contemplated by the invention advantageously mcludes meajis for acceptii« commented 
yes/no responses, and value selections from a user during a playback session. As 
discussed in more detail below under the heading defining Audio Programming with 
HTML,": these prompted user input responses are analogous to and can be composed 
using the <INPUT> tag form elements defined for use in standard hypertext markup 
language, where the "C" records in the selection file are analogous to <INPUT 
TYPE- 'text"> HTML tags, the "Y" selection file records are analogous to <INPUT 
is TYPE=>'checkbox"> tags, the "V" records are analogous ito <3NPUT TYPE^radio'^ 
radio button tags: Together these prompt mechanism provide a robust .mechanism for 
prompting the user for and collecting responses of various kinds. 

This mechanism for obtaining prompted responses may be advantageously 
employed to request information from subscribers. For example, prompted requests may 
be used to obtain program ratings from at least those subscribers who are willing to 
paroapate in the program rating process. Using *y" and "E" records, for example, a user 
may be asked to grade programs by various criteria and the resulting data may then be 
used alone or in conjunction with other values to produce a figure of merit for 
programming, whereby programs receiving higher ratings can be assigned a higher 
priority. In a suriilar fashion, willing subscribers may be offered the opportunity to 
volunteer to participate in surveys of various kinds, with the added advantage, that 
personal and preference data already available for each of the participants may be 
cranhined.wim the survey responses is useful ways. For example, the tendency to give a 
negative responses on a particular topic may be correlated with the age, sex, geographic 
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location, etc. of the respondents. Subscribers who are participate in the surveys may be 
rewarded by providing reduced subscription rates, free programs, or cash payments. 

As discussed previously in connection with Fig. 3 and 263-264, the embodiment 
which described also includes the capability of accepting comments from a subscriber at 
any time during the course of program playback. When such a comment is recorded, it 
is saved as separate file (or other identifiable data) together with the Program© of the 
program commented upon, the byte location within the playing program file where the 
comment or annotation is being made, a Class variable indicating the nature of the record, 
the Class variable being used as the Class variable in the Program_Segment record for the 
coinment or annotation or comment, and the date and time of day when the comment is 
beingcreated When the comment is created, the user is then requested to specify, either 
by voice response or by a keyboard selection, whether the information to be recorded is 
to be treated as: 

1. An annotation to be appended to the playing program record; or 

2. A comment which is treated as an independent message/program segment. 



The user fiirther indicates the extent to which such an annotation or comment is 
to be made available to others. If designated as being public, annotations become 
available to any other subscriber who subsequently plays the program, at least to the 
20. ^^^agivehsubsmWindicatM prf^ 
annotations are simply stored in the user's locd disk storage are (at 107 in Fig. 1) for 
future reference whereas pubHc annotations are uploaded to the serverwfaere they are 
saved as separate files keyed to the original by means of the downloaded selections file for 
those subscribers who desire to hear annotations, 

Cmmnente are designated as being public or private messages! Public comments 
become independently available to all subscribers who have indicated an interest in the 
subject matter category(s) to which the comment relates. By default, a comment is 
assumed to relate to the same categories assigned to the program segment which was 
playing when the comment was produced, but these category codes may be changed by 
the user during the editing session (seen at 217 in Fig, 2). In addition to altering the 
^^mattercodesforcoi^ 
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to the user at step 217 may advantageously include the ability to delete dictated comments 
so that they are not uploaded at all, direct comments to specific subscribers or email 
addresses, and enter new comments on any designated program segment in the current 
catalog by dictation or keyboarding. 

In order to provide an appropriate program description for longer topics, 
whenever a user records a comment have a duration which exceeds a predeteimined 
elapsed time, the player 103 performing the recording (at 264 in Fig. 3) produces an audio 
announcement requesting-that the us er dictate a brief summary of the comment which is 
usedtofonnthetopicdes^ In the catalog Usting 

provided to subscribers who desire access to comments as well as programs in a particular 
subject matter area, comments are listed in outline form as items which are subordinate 
to the parent program or comment to which they relate. The CommentOn field found in 
the ProgranvSegment record for each comment provides the information needed to 
display the hierarchical tree. The public comment meclianismwmemplated by tms aspect 
of the invention provides a useful facility which enables subscribers to exchange 
iitfonnatioh with each other in special interest groups which function much like the 
UseNet groups on the Internet, but with a conversational ease and informaUty that audio 
recording makes possible. 

A subscriber can elect the degree to which public comments or annotations are to 
played back along with programs or topics of specified interest Comments or annotations 
can be excluded entirely, a link may be imbedded which may be executed at user request 
to play me comment or annotation at the point in the file where the comment or 
annotation was played, or all comments and annotations may be played immediately 
without first requesting user approval 

Private comments are not posted to the subject matter categories and are made 
available only to (1) the author of [specMed by the ProviderJD of] me program segm^ 
being commented upon; (2) the host system, or a host system editor responsible for the 
subject matter area about which the comment is concerned; or (3) some other destination 
specified by the user. By sending comments to the author, the user can malce a direct but 
private response to anything contained in a message or program created by that author. 
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Particular advertisers or other content providers may encourage such comments and offer 
subscriber credits or other incentives to those who are willing to make comments. 

The ability to send comments to the responsible host editor provides a direct 
mechanism by which a subscriber may express satisfaction or dissatisfaction about the 
prograniming content provided, suggest 6ther prograjnming whicn would be of interest, 
and the like. Moreover, the to-host comment provides a mechanism to assist the editors 
to identify subscribers who may be inappropriately injecting offensive material to the 
annoyance of other subscribers. In addition, questions about the operation of the system 
may be directed to the host, thereby providing help and customer support to subscribers 
who may need assistance. Finally, the host may provide additional services (tact fmding, 
transactionprocessing, andthelike) which are made available on a f^^ 
subscribers. 

Finally, the ability to direct comments to specific people aJlows the system to 
provide voice-mail like fixnctions among subscribers. Using speech recognition, dictated 
comments.may be translated into text messages that could be sent to anyone having an E- 
mafl or receiver- Alternatively, the comment could be transmitted as an 

audio file attachment to an E-mail message (e.g. as a RealAudio file). In addition, like 
private annotations, the comment may simply be placed on the user's local disk for future 
reference. 

Comments and annotations an? preferabfystc^ on the player's locdr^ 
unit with header information designating a CommentON field (the ProgramJD of the 
program^egraent roinmented on), the byte location in the playing program file where the 
comment was dictated, the Class field speci£yii« the iiature of me comment 
Created date and time stamp. The files containing public and private annotations and 
comments (other than those designated for the sole use of the subscriber which remain on 
the local storage unit) are uploaded to the host at the same time the usage log is 
transferred (see 219, Fig. 2). 

Defining Audio Programming with HTML 

Nammvetexttobepr^ 
by the present invention may be advantageously expressed in the first instance using 
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essentially conventional hypertext markup language, "HTML". Fig. .7 shows an example 
of the content of a portion of an illustrative HTML text file indicated generally at 450 
used to create an audio file seen at 460 and a selections file indicated at 470. 

The HTML file illustrated at 450 uses conventional <OMG> tags to identify image 
files, conventional emphasizing tag pairs <EM> and </EM> to designate highlighted 
passages, and conventional <A > and </A> HTML tag pairs to designate the anchor text 
and link target of a hypertext link. Utilizing conventional HTML to describe the narrative 
content to be presented in audio form provides several significant advantages r not the least 
of which are: - 

(a) conventional HTML composition software may be used to add the image 
and emphasis tags by means of visual.tools which eliminate the need for 
hand-coding on a character level; 

(b) a narrative text version of the audio prognunming may be viewed and 
printed, including both the emphasized text and the imbedded images, 
using most popular web browsers; 

(c) existing HTML files may be readily converted into audio multimedia 
presentations with little or no HTML editing being required; 

(d) HTML file may be made available from a server in a form which can be 
viewed in the normal way by any web browser yet and alternatively 
presented accordance with the invention in the form of an interactively 
browsable audio program with synchronized images; 

(e) the HTML file may be supplied along with the audio-file as a transcript for 
the audio presentation, and to pemiit me audio presentation to be indexed 
and searched; and 

(f) the HTML may be automatically converted into the combination of an 
audio file using conventional speech synthesis techniques to.process the 
narrative text with the HTML tags being used to compile a selections file 
which enables the player to interactively browse the audio file using 
iiighlighted and linked passages, and to synchronize the image presentation^ 
with the audio file. 
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As seen inFig. 7, the HTML text passage seen at 450 begins with an image tag 
<IMG SKVTMDniBi jpo^, which to specify that the display of JPEGimage in the 
fflenamed«IMGFII£l.JP(r should begin at that point. TTie image tag is translated into 
apaa- of T' and T selection records seen at 472 which respectively contain the finagelD 
^^^^GFOMIJPG^j^^j^ , ocatioilinthe m6io ffle460 ^ 
the display of that image is to begin. This display continues until the next <IMG> tag is 
encountered "PeciryiiujthelMG^ 

recordpairat473. The <L\1GGFF> is not standard HTML and hence would beignored 
by conventional web browsers, but is inserted for recognition by the selections file 
compiler which responds by inserting the "K> record at 474 which specifies the point at 
which the current image display should end. 

Immediately thereafter, the phrase Revision and motion pictures" is identified 
*s a Mghhghted passage by the tag pair <EM> and <VEM> seen in the text 450 These 
tags are translated into the «H» and «E» record pairs at 475 in the selections file 470 which 
identify the beginning and ending of the phrase in the audio file. As discussed earlier in 
conjunction withKg. 5, the Mghlight markers in the selections file enable the player to 
play only the highlighted passages when in the highlight mode. A second «H» and 
record pair seen at 476 is produced by the HTML text "<EM>bandwidth<^M>". 

A conventional HTML, hypertext anchor "<A HRHf='target*>fiill motion 
video</A>" is processed to. produce the three records "A", "B» and «L" at 478 in the 
selections file which respectively designate the beginning ami ending of the anchor text 
passage and the location of a linked information The "HREF='target- portion of the 
HTML specifies the target location in conventional HTML and that symbolic address is 
thm translated by tte^ 

the selections file record which refers to that target or, for targets in program segments 
which are not part of the currently scheduled prognmntring defined by the selections file, 
by a negative number representing the negative of the ProgramID number of the targe! 
program segment. 

. The HTML forms mechanism may also be used to incorporate requests for user 
input at predetermined times during the playback of program segments. As described 
earlier in connection with Fig. 5, user inputs may take the form of recorded comments and 
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annotations which are analogous to the <INPUT TYPE="text"> and the <TEXTAREA> 
tagged requests in an HTML form which similarly request the recipient to supply text 
data. In addition, the embodiment of the invention which has been described incorporates 
a mechanism for accepting "YESTNO" selections from a user which is analogous the 
HTML form <3NPUT TYPE=»ch e ckbox»> tag. Similarly, the value choice mechanism 
using "V selection records provides a radio-button-styie mechanism for indicating a 
user's choice from among several options. 

Standard HTML input tags include a Name attribute which can be used as an 
identifier for the data entered. As HTML is translated into an equivalent audio file, the 
tags in the written HTML are translated into records in the selections file which contain 
byte location values specifying when the player should. pause the playback and accept the 
userresponse. The resulting uploaded usage log file (containing responses to radio and 
checkbox input tags) contains the response value together with the original byte location 
value from the selections file which serves the tag identifier. In order to facilitate 
processing of the responses, the HTML to audio conversion process may advantageously 
save a table correlating the Name values in the HTML source with the byte location • 
.values. In this way, the input tag Name parameter may be used as a symbolic identifier 
to identify and process response data. 

The HTML input tag Value parameter is conventionally used to supply a default 
response value to betupplied when the user does not supply a different response. Value 
parameters may accordingly be saved for later use and inserted as output data when the 
user does not respond to the request for input, (as indicated by the absence in the uploaded 
files of any response data containing the byte location value for the tag not responded to). 
In the same way, hidden HTML tags may be imbedded in the original HTML and saved 
during the HTML to audio conversion to indicate the correspondence between particular 
byte locations in the audio file and symbolic location names identified by the symbolic 
Name parameter specified in the hidden tag. Such hidden tags may be used, for example, 
to identify the beginning and end of particular passages and may be compared with the 
usage logs to determine the extent to which users exercised their option to skip the 
30 remainder of a program during the designated passage. 
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Conclusion 

It. is to be understood that the embodiment of the invention which has been 
described is merely illustrative of one application of the principles of the invention. 
Numerous modifications may be made to the specific structures and functions used in that 
embodiment without departing from the true spirit and scope of the invention. 
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What is Claimed is: 

1 . A personalized electronic information delivery system comprising, in combination, 
a host subsystem comprising: 

a file storage server for storing a library of program segments, at least some of 
which include natural language text recorded in digital compressed form, 

means for storing a category description for each of a plurality of subject matter 
categories, 

means for storing a program description of each of said program segments, each 
of said program descriptions including the identification of one or more of said subject 
matter categories to which the described program segment belongs, 

means for storing a subscriber description of each of a plurality of subscribers, 
each of said subscriber descriptions containing information indicative of particular subject 
matter categories designated as being of interest to the described subscriber, 

means for compiling a personalized catalog of suggested program segments for 
a given one of said subscribers, said personalized catalog consisting of category 
descriptions and program descriptions selected in accordance with the subscriber 
description for said given subscriber, 

means for transmitting said personalized catalog upon request, and 

means for transmitting identified ones of said program segments upon request, 
a data communications pathway, and a client player device located remotely from said file 
storage server, said player device comprising, in combination: 

means for establishing a bi-directional data transfer connection between said player 
device and said file storage server, 

means for transferring information to said host system for inclusion in a subscriber 
description for a designated subscriber having access to said player device, 

means for transmitting to said host system a request for a personalized catalog 
compiled for said designated subscriber, 

means for receiving the requested catalog from said host subsystem, 
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6. A stem as set forth in claim 5 wherein said subscriber attribute information, 
specifies the age of said subscriber and wherein said program descriptions specify the ages 
of subscribers to whom the described segment may be of interest. 

7. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the sex of said subscriber and wherein said program descriptions specify the sex 
of subscribers to whom the described segment may be of interest. 

8.. A system as set forth in claim 5 wherein said-subscriber attribute information 
specifies the marital, status of said subscriber and wherein said program descriptions 
specify the marital status of subscribers to whom the described segment may be of 
interest. 

9. A system as set forth in claim 5 wherein said subscriber attribute information 
specifies the geographic location of said subscriber and wherein said program descriptions 
specify the geographic location of subscribers to whom the described segment may be of 
interest. 

10. A personalized electronic information delivery system as set forth in claim 1 
wherein at least some of said category descriptions further contain information indicative 
of other cross-referenced subject matter categories to which the described category is 
related and wherein said means for compiling said catalog includes means, for including 
said cross-referenced category descriptions in said catalog. 

11- A personalized electronic information delivery system as set forth in claim 1 
wherein said data communications pathway is a digital transmission system and wherein 
said file storage server stores said programs in identified files which may be transmitted 
via said digital transmission system. 

12. A personalized electronic information delivery system as set forth in claim 1 1 
wherein each of said program descriptions includes mearisfor identifying one or more files 
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stored on said file storage server which relate to the program segment described by that 
program description. 

13. A personalized electronic information delivery system as set forth in claim 1 
wherein said host subsystem further comprises: 

Means for receiving from a subscriber via said communications pathway a search 
request for the identification of program segments satisfying criteria specified in said 

search request, • ^ 

means for compiling a listing of said programs satisrying sdd crfteria, and 
means for transrnhting said listing to that subscriber which issued said search 
request. 

14. A personalized electronic information delivery system as set forth in claim 1 
wherein said host subsystem further comprises means for compiling a program schedule 
consisting of an ordered sequence of selected ones of said program segments and means 
for transferring said program schedule to said client player via said communications 
pathway, and wherein said client player includes means for reproducing said selected ones 
of said program segments. 

15. A system as set forth in claim 14 wherein said client player includes means for 
reproducing said selected ones of said program segments in the order specified in said 
program schedule. . 

16. A system as set forth in claim 14 wherein said client player includes means for 
altering said program schedule to edited scnedme and me^ for reproducing^ 
program segments in the order specified in said edited schedule 

17. A system as set forth in claim 14 wherein said client player includes means locally 
storing program segments received from said host subsystem, means for comparing the . 
specification of program segments contained in said program schedule with the identity 
of program segments locally stored by said client player, and means for. transrnhting a 
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request to said server subsystem for programs segments specified in said program 
schedule but not locally stored by said client player. 



18. A personalized electronic information delivery system as set forth in claim 1 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes means for processing said 
usage log to produce billing information for said subscriber. 

19. A personalized electronic information delivery system as set forth in claim 1 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said catalog 
of suggested program segments at least some, of the program segments identified on s aid 
usage log as having been played. 

20. A personalized electronic information delivery system as set forth in claim 14 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said 
program schedule at least some of the program segments identified on said usage log as 
having been played. 



20 21 - A personalized electronic information delivery system comprising, in combination, 
an Internet host subsystem comprising: 

a file storage server for storing a plurality of program segments, at least some of 
which include natural language text recorded in digital compressed form and stored as 
named retrievable files, 

means for storing a category description for each of a plurality of subject matter 
categories,. 
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means for storing a program description of the information content of each of said 
program segments, each of said program descriptions including the identification of one 
or more of said subject matter categories to which the described program segment 
belongs, 

means for storing a subscriber description of at least one subscriber, said 
subscriber description containing information indicative of particular subject matter 
categories designated as being of interest to said subscriber, 

means for compiling a personalized catalog of suggested program segments for 
use by said subscriber, said personalized catalog consisting of category descriptions and 
program descriptions selected in accordance with said subscriber description, 
a port for establishing a data communications pathway to the Internet, 
means for transferring said personalized catalog to said subscriber, and 
means for transmitting identified ones of said program segments to said subscriber 
upon request, and 

a client player device accessible to said subscriber at a geographic location remote 
from said host subsystem, said player device comprising, in combination: 

means for establishing a data transfer connection via the Internet between said 
player device and said Internet host subsystem, > 

means for transferring information describing said subscriber to said host system 
for inclusion in said subscriber description, 

means for transmitting to said host system a request for a said personalized 
catalog, 

means for receiving the requested catalog from said host subsystem, 

means for transmitting, said to said host system a request for one or more desired 

program segments selected from the suggested program segments in the requested 

catalog, and 

means for receiving said desired program segments from said host system, and 
means for reproducing said natural language text in a form comprehensible to a 
human user from selected ones of said program segments. 
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22. A personalized electronic information delivery system as set forth in claim 21 
wherein said natural language text recorded in impressed form consists ofa digital audio 
recording of spoken natural language text. 

5 23, A system as set forth in claim 22 wherein said host subsystem further includes 
means for storing digital data representing a transcript of at least a portion of the spoken 
natural language text recorded in at least some of said program segments. 

.24. A personalized electronic information delivery system as set forth in claim 21 
10 wherein said natural language text recorded in compressed form consists of digital data 
representing a sequence of words expressed as text characters and wherein said means for 
reproducing said natural language text in a form comprehensible to a human user 
comprises speech synthesis means for converting said word into audible spoken form 
understandable to a human listener. 

15 

25. A personalized electronic information delivery system as set forth in claim 21 
wherein said subscriber descriptions include information describing the attributes of a 
given subscriber and wherein at least selected ones of said program descriptions contain 
subscriber attribute information specifying the attributes of subscribers to whom the 

20 described program segment may be of interest, and wherein said means for compiling a 
personalized catalog includes means for matching the attributes in said subscriber 
descriptions to the subscriber attribute information in said program descriptions. 

26. A system as set forth in claim 25 wherein said subscriber attribute information 
specifies the age of said subscriber and wherein said program descriptions specify the ages 

25 of subscribers to whom the described segment may be of interest. 

27. A system as set forth in claim 26 wherein said subscriber attribute information 
specifies the sex of said subscriber and wherein said program descriptions specify the sex 
of subscribers to whom the described segment may be of interest. 

30 . 
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28. A system as set forth in claim 27 wherein said subscriber attribute information 
specifies the marital status of said subscriber and wherein said program descriptions 
specify the marital status of subscribers to whom the described segment may be of 
interest. 



29. A system as set forth in claim 28 wherein said subscriber attribute information 
specifies the geographic location of said subscriber and wherein said program descriptions 
specify the geographic location of subscribers to whom the described segment may be of 
interest. - . 

30. A personalized electronic information delivery system as set forth in claim 21 
wherein at least some of said category descriptions further contain information indicative 
of other cross-referenced subject matter categories to which the described category is 
related and wherein said means for compiling said catalog includes means for including 
said cross-referenced category descriptions in said catalog. 

31.. A personalized electronic information delivery system as set forth in claim 21 
wherein said data wnirminications pathway is a digital transmission system and wherein 
said file storage server stores said programs in identified files which may be transmitted 
via said digital transmission system. 

32. A personalized electronic information delivery system as set forth in claim 3 1 
wlierein each of said program descriptions includes means for identifying one or more files 
stored on said file storage server which relate to the program segment described by that 
program description. 

33. A personalized electronic information delivery system as set forth in claim 21 
wherein said host subsystem further comprises: 

^forrecervingfiraawb^ 

request for the identification of program segments satisfying criteria specified in said 
search request, 



78 



WO 99/431 11 v PCT/US98/03444 

means for compiling a listing of said programs satisfying said criteria, and 
means for transmitting said listing to that subscriber which issued said search 
request. 

5 34. A personalized electronic information delivery system as set forth in claim' 21 
wherein said host subsystem further comprises means for compiling a program schedule 
consisting of an ordered sequence of selected ones of said program segments and means 
for transferring said program schedule to said client player- yja said communications 
pathway, and wherein said client player includes means for reproducing said selected ones 

10 of said program segments. 

35. A system as set forth in claim 34 wherein said client player includes means for 
reproducing said selected ones of said program segments in the order specified in said 
program schedule. 



IS 



36, A. system as set forth in claim 34 wherein said client player includes means for 
altering said program schedule to form an edited schedule and means for reproducing the 
program segments in the order specified in said edited schedule 

20 37. A system asset forth in claim 34 wherein said client player includes means locally 
storing program segments received from said host subsystem, means for comparing the 
specification of program segments contained in said program schedule with the identity 
of program segments locally stored by said client player, and means for transmitting a 
request to said server subsystem for programs segments specified in said program 

25 schedule but not locally stored by said client player. 

38. A personalized electronic information delivery system as set forth in claim 21 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for traiisinitting said usage log to 
30 said host subsystem, and wherein said host subsystem includes means for processing said 
usage log to produce billing information for said subscriber. 
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39. A personalized electronic information delivery system as set forth in claim 21 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said catalog 
of suggested program segments at least some of the program segments identified on said 
usage log as having been played. 

40. A personalized electronic information delivery system as set forth in claim 37 
wherein said client player system includes means for recording a usage log containing the 
identification of program segments played and means for transmitting said usage log to 
said host subsystem, and wherein said host subsystem includes excluding from said 
program schedule at least some of the program segments identified on said usage log as 
having been played. 

41 . A co mmuni ca ti ons system for distributing audio recordings among a plurality of 
system subscriber stations located remotely from one another, said system comprising: 

a co mmun ications network interconnecting said system subscribers, 

a subscriber access device connected to said network at each of said subscriber 
stations, said access device comprising: 

playback means for reproducing a selected audio recording received from said 
network for a listener, 

input means for accepting a spoken message from said listener concurrently with 
the reproduction of said selected audio recording, 

means for recording said spoken message and identification data associating said 
spoken message with said selected audio recording to form a subscriber generated 
recording, and 

means for tra nsmitt ing said subscriber generated recording over said network, and 
routing means coupled to said network and responsive to said identification data for 
transferring said subscriber generated recording to one or more of said subscribers. 



80 



WO 99/431 11 PCT/US98/03444 

42.. A communications system as set forth in claim 41 wherein said spoken message 
is an audio annotation to be appended to said selected audio recording and wherein said 
identification data includes the specification of a chosen position in said selected audio 
recording to which said audio annotation relates. 

43. A communications system as set forth in claim 42 wherein said input means 
includes means actuated by said listener for initiating the acceptance of said spoken 
message arid wherein said chosen position is the position in said selected audio recording 
being reproduced when said acceptance was initiated by said listener. 

44. A communications system as set forth in claim 42 wherein said routing means 
includes means for transferring said subscriber generated recording of said audio 
annotation to subscribers who thereafter receive transfers of said selected audio recording. 

45. A communications system as set forth in claim 44 wherein said playback means 
includes means responsive the receipt of a subscriber generated recording of an audio 
annotation for playing said , audio annotation when said position is reached during the 
playback of said selected audio recording. 

46. A communications system as set forth in claim 41 wherein said identification data 
is indicative of at least one subject matter category and wherein said routing means 
includes: 

means for storing data identifying a subset of subscribers having an interest in 
information within said one subject matter category, and 

means for transferring said subscriber generated recording to one or more of said 
subscribers in said subset 

47. A communications system as set forth in claim 46 wherein said at least one subject 
matter category is a subject matter category associated with said selected audio recording. 
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48. A communications system as set forth in claim 46 wherein said routing means for 
transfening said subscriber generated recording to said subscribers in said subset includes 
means responsive to preference data supplied by a receiving subscriber for encouraging 
or inhibiting the transfer of said subscriber generated recording to said receiving 
subscriber. 

49. A communications system as set forth in claim 41 wherein said selected audio 
recording was produced by an originating subscriber and wherein said routing means 
includes means for transferring said subscriber generated recording as a response to said 
originating subscriber. 

50. A communications system as set forth in claim 49 further including means for 
storing the identification of a subset of subscribers who have an interest in each of a 
plurality of subject matter topics, wherein said identification data further includes the 
specification of one or more subject matter topics to which said subscriber generated 
recordings relate, and further including means for transferring to those subscribers having 
an interest a given topic an identification of subscriber generated recordings which include 
me specification of said given topic. 

51. Apparatus for exchanging information relating to a plurality of subject matter 
topics between a plurality of participants located remotely from one another, said 
apparatus comprising, in combination: 

an electronic data communications network interconnecting said participants, 

one or more audio recording units coupled to said network for recording audio 
messages spoken by each of said participants, 

means for persistently storing each given one of said audio messages with 
identification data designating one or more of said subject matter topics to which said 
given audio message relates, 

means for providing to a requesting participant an identification of previously 
stored messages relating to a subject matter topic specified in a request for information, 
and 
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an audio playback unit for reproducing stored messages specified in said 
identification. 

52. Apparatus as set forth in claim 51 wherein each of said audio recording units 
includes means operable by a participant for recording a comment relating to a particular 
previously stored message wherein the identification data stored with said comment 
designates one or more of the subject matter topics to which said previously stored 
message relates. 

53. Apparatus as set forth in claim 52 further including: 

means for persistently storing pre-recorded programs each of which relates to one 
or more of said subject matter topics, and 

means for additionally providing a requesting participant an identification of pre- 
recorded programs relating to a subject matter topic specified in a request for information. 

54. Apparatus for obtaining information responsive to request for information request 
which comprises, in combination, 

means for recording said request for information as an audio recording containing 

a spoken request prompt and a recorded request marker specifying a position in said audio 

recording subsequent to said request prompt, 

playback means for reproducing said spoken request prompt for a listener, 
input means initiated by .said recorded request marker for temporarily suspending 

the operation of said playback means while accepting a spoken response from said listener, 

and 

recording means for storing said spoken response together with identification data 
designating said request 

55; Apparatus as set forth in claim 54 wherein said identification data comprises a 
designation of said audio recording and a designation of the position of said request 
marker in said audio recording. 
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56. Apparatus as set forth in claim 54 wherein said input means further comprises 
means actuated by said listener for initiating the acceptance of a spoken message and 
wherein said recording means further comprises means for storing said spoken message 
together with a designation of said audio recording and a designation of the position in 
said audio recording at which the acceptance of said spoken message was initiated by said 
listener. 

57. A method for producing and processing an audio questionnaire comprising, in 
combination, the steps of: 

storing an electronically readable file of text characters consisting of natural 
language text and at least one response request marker indicating a position relative to 
said natural language text where a response is to be inserted by a human listener, 

using speech synthesis processing to convert said electroiiically readable file of text 
characters into a corresponding audio file of spoken natural language, 

converting said response request marker in said file of text characters into timing 
data indicating said position in said audio file, 

reproducing said audio file for said human listener, 

temporarily suspending the reproduction of said audio file at said position in said 
audio, file indicated by said timing data, and 

accepting and recording a spoken response from said listener while said 
reproduction is temporarily suspended. 

58. A method as set forth in claim 57 for producing and processing an audio 
questionnaire wherein said response request marker further specifies a selected one of a 
group of predetermined response types. 

59. Amethod as set forth in claim 58 wherein said a group of predetermined response 
types includes a spoken response recorded stored as an audio recording and a spoken 
response recorded as a one a predetermined set of data values. 
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60. A system for storing and reproducing audio programming concurrently with the 
synchronized display of one or more stored images which comprises, in combination,. 

means for storing sequential digital data, representing an Audio program, 

means for storing a digital data representing an visible image, 

means for storing synchronizing information specifying a limited portion of said 

sequential digital data representing a designated passage within said audio program, 
audio player means for reproducing said audio program by converting said 

sequential digital data into audible form, and 

. means for visually displaying said image data concurrently with the reproduction 

of said designated passage. 

61 . A system for storing and reproducing audio programming as set forth in claim 1 
wherein said means for storing sequential data representing an audio program comprises 
means for storing a file of natural language text and wherein said audio player means for 
reproducing said audio program comprises speech synthesis means text file into audible 
spoken form. 

62. A system as set forth in claim 60 wherein said synchronizing information 
comprises one or more records identifying a said digital data representing said visible 
image and further identifying locations within said sequential digital data which 
correspond to the beginning and end of said designated passage. 

63 . A computer system for storing and reproducing, audio programming concurrently 
with the synchronized display of one or more visible images, said system comprising, in 
combinanon.mass storage means for storing sequential digital data representing said audio 
programming, image data representing said visible image, and synchronizing data relating 
said image data to an identifiable contiguous portion of said sequential file, 

a display for converting said image data into said visible image, and 

processing means for processing means for converting said sequential digital data 
into an audible signal and for activating said.display means to display said visible image 
beginning and ending at times specified by said synchronizing data. 
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64- A system for storing and reproducing audio programming as set forth in claim 4 
herein said means for storing sequential data representing an audio program comprises 
means for storing a file of natural language text tod wherein said audio player means for 
reproducing said audio program comprises speech synthesis means text file into audible 
spoken form. 



65. Apomi>utersystemforproauc^ 
ofoneo^imagess^ 

means for storing a sequential digital file representing natural language text 
incorporating at predetermined positions therein unique tag characters designating marked 
positions in said •natural language text, 

means for storing image data represeiiung one or more visual images, : 
speech synthesis means for converting said sequential digital file into audible speech 
representing said natural language text in spoken form, and 

means for detecting the presence of said unique tag characters in said sequential 
digital file to produce one or more control values, arid 

display means response to said control values for producing said visual images at times 
predetermined times relative to said audible speech. 

66. A computer system as set forth in claim 65 wherein said sequential digital file 
representing "atiirdlangt^textfa 

which is displayable and printable using a conventional web browser. 

67. A computer system as set form in claim 66 wherein said tag markers include 
hypertext markup language image tags of the form <TMG SRC=TmageID"> where 
Image© is a symbolic variable identifying^ 

wherein the position of each such image tag specifies the time relative to said audible 
speech when said visual image is displayed by said display means. 
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68. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language text formatting tags which specify particular highlight 
passages in said natural language text and further including means for detecting said 
fonnatting tags to produce playback control values and means responshre.to said playback 
control values to selectively reproduce said higMightpassages in spoken form. 

69. A computer system as set forth in claim 66 wherein said tag markers include 
hypertext markup language link markers which specify particular anchor passages in said 
natural language text and former , including means for detecting said link markers to 
produce link control values and means jointly responsive to said link control values and 
to a request from a user for performing a jump to different position in said digital 
sequential.file at which different position said speech synthesis means continues the 
conversion of said sequential digital file into audible speech. 

70. A computer system as set forth in claim 67 wherein said tag markers further 
include hypertext markup language text formatting tags which specify particular highlight 
passages in said natural language text and further including means for detecting said 
formatting tags to produce playback control values and means responsive to said playback 
control values to selectively reproduce said highlight passages in spoken form. 

71. A computer system as set forth in claim 67 wherein said tag markers include 
hypertext markup language link markers which specify particular anchor passages in said 
natural language text and further including means for detecting said link markers to 
produce link control values and means jointly responsive to said link control values and 
to a request from a user for performing a jump to different position in said digital 
sequential file at which different position said speech synthesis, means continues the 

25 conversion of said sequential digital file into audible speech. 

72. A system for storing and reproducing natural language text in both spoken and 
written which comprises, in combination, 



is 



20 



87 



WO 99/43111 

PCT/US98/03444 

means for storing sequential digital data representing an audio program containing 
spoken text, 

means for storing a digital data representmg a sequence of characters fonnmg a 
transcript of said spoken text in said audio program, 

means for storing synchronizing information specifying the location of at least one 
designated spoken passage in said audio program and a location of the corresponding 
sequence of characters in said transcript corresponding to said spoken passage, 
audio player means for reproducing said audio program by converting said sequential 
digital data into audible form, and 

means responsive to said synchronizing information for visually displaying said 
corresponding sequence of characters concurrently with the reproduction of said 
designated spoken passage. 

73. Apparatus as set forth in claim 72 including means responsive to the designation 
of a target sequence of characters for searching said transcript for a matching sequence 
of characters equivalent to said target sequence, and means for reproducing a portion of 
said audio program containing a spoken passage corresponding to said notching sequence 
of characters in said transcript 



74. A system for delivering pre-recorded programs to a subscriber comprising, in 
combination: 



i for storing a libraiy consisting of a plurality of separate program-segments, 
means for storing category definition data descnT)mgapluralHyof subjeotmatter 
categories, 

meaMfbrstoringiTOgRu^^ 

matter categories to which each of said programs relates, 

means for storing data describing a plurality of subscribers, deluding data 
designating at least one of said categories for each of said subscribers, 

, ^^comparingsaiddatadescn^ 
with said program description data to compile an identification of program segments of 
potential interest to said given subscriber, 
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means for transferring said identification of programs to said given subscriber, 
means responsive to a request from a subscriber for transferring requested 

program segments from said library to the requesting subscriber, and 

means for receiving from said requesting subscriber a usage log identifying the 

program segments actually used by said requesting subscriber. 

75. A system as set forth in claim 74 wherein said identification of programs 
transferred to said subscriber comprises a program schedule consisting of an ordered 
sequence of program identifiers; 

76. A system as set form in claim 75 further includes a player device accessible to each 
of said subscribers for reproducing said program segments specified by said program 
identifiers in the order specified by said program schedule. 

77. A system as set forth in claim 75 further including means for excluding from said 
program schedule for any subscriber the identification of any program segment previously 
identified as actually used by that subscriber in a usage log. 

78. A system as set forth in claim 77 wherein said program schedule comprises 
programs*** in said specification received from said given subscriber and further 
comprises additional programs selected by comparing said data describing said given 
subscriber with said program description data. 

79. Asystem for delivering pre-recorded progranis to a subsm^er comprising, a host 
subsystem comprising: 

means for storing a library consisting of a plurality of separate program segments, 
means for storing category definition data describing a plurality of subject matter 
categories, 

means for storing program description data specifying, for each given one of said 
programsegments, at least one of said subject matter categories to which said given one 
of said program segments relates, 
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means for storing subscriber data describing a plurality of subscribers, including data 
designating at least one of said categories for each of said subscribers, 

means for comparing said data describing at least a given one of said subscribers 
with said program description data to compile a catalog of program segments, each 
catalog containing an identification of a set of program segments of potential interest to 
said given subscriber and a narrative description of the programs segments identified in 
said catalog, 

means for transmitting said catalog to said given subscriber, 
means for receiving from said given subscriber a specification of programs ide^ 
in said catalog, 

means for transmitting to said given subscriber a program schedule consisting of an 
ordered sequence of program identifications, and 

means responsive to a request from said given subscriber for transferring requested 
program segments from said library to said given subscriber, and 

a player device accessible to said given subscriber for selectively reproducing said 
program segments specified by said program identifiers in the order specified by said 
program schedule, said player device further comprising: 

recording means coupled to said player device for recording a usage log containing 
an identification of each program segment actually played by said player device, and 

means for transmitting said usage log to said host subsystem. 

80. « A system as set forth in claim 79 including local storage means accessible to said 
player device for storing program segments transferred from said library to said given 
subscriber. 

81 . A system as set forth in claim 7? further includes a player device further includes 
editing means operable by said subscriber for modifying said program schedule. 

82. A system as set forth in claim 80 further including means for excluding from said 
program schedule for any subscriber the identification of any program segment previously 
identified as actually used by that subscriber in a usage log. 
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83; A system.as set forth in claim 79 wherein said program schedule comprises 
programs in said specification received from said given subscriber and further comprises 
additional programs selected by comparing said data describing said given subscriber with 
said program description data. 

84. A system as set forth in claim 82 further including means for excluding from said 
program schedule and said catalog for any subscriber the identification of any program 
segment previously identified as actually used by that subscriber in a usage log. 

85. A system as set forth in claim 79 further including means for processing said usage 
logs to adaptive* modifying said subscriber data to indicate of the character of programs 
actually used by each of said subscribers. 

86. A system for delivering pre-recorded programs to a subscriber comprising, in 
combination: 

means for storing a library consisting of a plurality of separate program segments, 
means for storing category definition data describing a plurality of subject matter 
categories, 

means for storing program description data specifying at least one of said subject 

matter categories to which each of said programs relates, 

means for storing subscriber data describing a plurality of subscribers, including data 
designating at least one of said categories for each of said subscribers, 

means, for comparing said data describing at least a given one of said subscribers 
with said program description data to compile a catalog of program segments, each 
catalog coinaining an identification of a set of program segments of potential interest to 
said given subscriber and a narrative description of programs segments identified in said 
catalog, 

means for transmitting said catalog to.said given subscriber, 
; means operable by said given subscriber for selecting a set of desired program 
segments from said catalog, 
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means for receiving from said given subscriber a specification said set of desired 
programs, 

means for traiismitting to said given subscriber a program schedule consisting of an 
ordered sequence of program identifications, 

means responsiveto a request from a subscriber for transferring requested program 
segments from said library to the requesting subscriber, and 

means for receiving from said requesting subscriber a usage log identifying the 
program segments actually used by said requesting subscriber. 

87. A system as set forth in claim 86 further includes a player device accessible to each 
of said subscribers for reproducing said program segments specified by said program 
identifiers in the order specified by said program schedule. 

88. A system as set form 
program schedulefbrarysubscnW^^ 

identified as actually used by that subscriber in a usage log. 

89. Asystemassetforflmda^^ 

in said specification received from said given subscriber and further comprises additional 
programs sdected by comparing said data describing said given subscriber with said 
program description data. 

90. A system as set forth in claim 89 rurther including means for excluding from said 
program schedule and said catalog for any subscriber me ideiitffication of any program 
segment identified as actually used by that subscriber in a usage log. 

91. A system as set forth in claim 86 further induding means for processing said usage 
logs to adaptivdy modify said subscriber data to indicate of the character of programs 
actuafly used by said subscribers. 



92 



W ° 99/43,n . .. PCT/US98/03444 

92. A system as set forth in claim 86 wherein said subscriber data further includes data 
indicating the total duration of playing time available to at least selected ones of said 
subscribers and means for limiting the playable duration of the program segments 
identified in said ordered sequence in accordance with said total duration. 

93. A system as set forth in claim 91 further includes means responsive to said usage log 
for modifying said playable duration in accordance with the percentage of segments 
previously skipped by said requesting subscriber. 

94. A system as set forth in claim 86 including means for transmitting to said subscriber 
an indication of optimum times for requesting the transfer of requested program segments. 

95. A system as set forth in claim 86 further wherein said subscriber data further 
comprises an indication the time of day when a playing session is scheduled to begin for 
said requesting subscriber on each day of the week. 

96. Asystemassetforfotoda^ 

indication of the expected duration of said playing session for said requesting subscriber 
on each day of the week. 

97. A player for reproducing selected audio program segments comprising, in 
combination: 

means for storing a plurality of program segments, each of said program segments 
having a beginning and an end, 

means for storing data estabUshing a sequence in which said program segments are 
scheduled to be reproduced by said player, 

means for accepting control commands from a user of said player, 

means for reproducing said , program segments in the order established by said 
sequence in the absence of a control command, 

means for detecting a first command indicative of a request to skip forward, and 
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means responsive to said first command for discontinuing the reproduction of the 
currently playing program segment and instead continuing the reproduction at the 
beginning of a program segment which follows said currently playing program in said 

sequence. 



98. . A player as set forth in claim 97 further comprising means for detecting a second 
command indicative of a request to skip backward, and 

means responsive to a single one of said second commands for discontinuing the 
reproduction of the currently playing- program segment and instead continuing the 
reproduction at the beginning of said cun^y playing program. 

99. A player as set forth in claim 98 further comprising means responsive to the 
detection of two consecutive ones of said second commands for discontinuing the 
reproduction of the currently playing program segment and instead continuing the 
reproduction at the beginning of a program segment which precedes the currently playing 
program segment 

100. A player as set forth in claim 97 wherein said sequence established by said data 
forms an endless circular sequence of program segments. 

101. A player as set forth in claim 97 including editing means for modifying said data 
establishing said sequence. 

102. A player as set forth in claim ioi wherein said editing means includes means for 
reordering the sequence established by said data. 

103. Aplayerassetfo rt hmclaim97wher^ 

segments includes means for varying the rate at which said program segments are 
reproduced.. 
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104. ApIayerassetformmclaimip3whe^ 

said program segments are reproduced includes means for skipping periods of silence 
between words 6r other sounds when said program segments are reproduced. 

105. A player as set forth in claim 103 wherein said means for varying said rate 
comprises means for designating portions of said program segments as highlight passages 
and means responsive to a request from aid user for reproducing said highlight passages 
without i^roducing at least some portions of said program segments which are adjacent 

to said highlight passages. 



106. Aplayer as set forth in claim 97 wherein said means for repro4ucmg said program 
segiheiitsmduding means for accepting a bookmarkingi^ueat from said user, means for 
storing bookmark data indicating the program segment being reproduced at the time said 
bookmarking request is accepted. 

107. A player as set forth in claim 97 wherein said program segments include 
descriptive program segments, each given descriptive segment containing information 
which when reproduced for the listener describes the content of one or more other 
program segments which immediate follow said given descriptive segment, and 

wherem said player fordier conmrisw 
operative when one of said descriptive segments is currently playing for discontinuing the 
reproduction of said currently playing descriptive segment and instead contmuing.the 
reproduction at the b eginning of the next descriptive segment m said sequence. . 

108. A player as set forth in claim 97 wherein said player fiuther comprises: 
means for storing data indicative of highlight passages within at least selected ones 

25 of said program segments, and 

means responsive to a predetermined one of said control commands for 
reproducing only the highlight passages whhm said selected program segmerits. 
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comprising, in combination: 

input means for Accepting control commands from a -user 

program segments in a form audible to said user, 

— -P^ .0 a to or* of »id con*,, commands for 
^mmumg *. tr^on of me ^ ^ ^ ^ ^ ^ 

<^on«thebegmningofsddcurrentlypl^ ^ 

V* 

HI. Aprograinmed^ 



tUtmiA*-^.- programs as set forth in 

sadcumndyptayiiyjRrognuBtosaJdwiquence. ' 



^.hecon^ofoneormoreomerprogram^^^^^ 
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said descriptive segment in said sequence and wherein said processing means responsive 
to said a first one of said control commands continues the translation at the beginning of 
the next descriptive command when the currently playing program segment is a descriptive 
segment. 

113. A programmed digital computer as set forth in claim 16 wherein said input means 
comprise a microphone for accepting voice commands spoken by said user. 

- 1 14. A player device for mteractively reproducing selected audio program segments 
from a program library comprising, in combination: 

storage means for storing a plurality of program segments each containing an 
audio presentation; 

means for storing a program schedule establishing an ordered sequence of said 
program segments to form a continuously playable audio program session; . 

output means for converting the audio presentation at a current playback position 
in said session into an audible form perceivable by a listener, 

means for identifying at least one hyperlink anchor passage within said session; 

means for associating said anchor passage with a linked playback position in said 
session different from the playback position of said anchor passage; 

means for producing an output indication perceivable to said listener whenever 
said hyperlink anchor passage is reproduced by said output means; 

input means for accepting a hyperlink execution commands from a listener, and 
means responsive to said execution command for changing said current playback position 
in said session to said linked playback position. 

115. A player device as set forth in claim 1 14 wherein said output indication is an 
audible cue signal produced in timed relation to the reproduction of said anchor passage. 

1 i6. A player device as set forth in claim 1 14 wherein said means for identifying said 
anchor passage comprises an anchor passage identifier stored with said program schedule. 
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sess!oll i™»"gMWUioiit playing other portions of said 
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m>m» program horary comprising, fa contfMnatton: 
a library saver storing said program horary; 

^foideot^^ta^^^^^^ 
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120. A player device as set forth in claim 1 19 wherein said output indication is an audible 
cue signal produced in timed relation to the reproduction of said anchor passage. 

121. A player device as set forth in claim 1 19 wherein said means for identifying said 
anchor passage comprises an anchor passage identifier stored with said program schedule. 

122. A player device as set forth in claim 121 further comprising means for identifying 
a plurality of highlight passages within session, and means responsive to a request from 
said listener for playing said highlight passages without playing other portions of said 
session. 

123. A player device set forth in claim 119 including means for identifying subject 
description passages within said session, each given descriptive passage containing 
information describing of a portion of said session which follows said given descriptive 
passage, and means responsive to a request from said listener for reproducing the next 
descriptive passage in said session following said current playback position in said session. 

124. A player device as set forth in chum 1 19 wherein said library server includes means 
for producing said program schedule and said player device includes means for receiving 
said program schedule from said library server; 

125 . A system for reproducing selected program segments containing audio presentations 
from a program library comprising, in combination: 
a library server storing said program library, 

a communications facility for transferring program segments from said library server 
to player devices located remotely from said program library, each of said player devices 
comprising: 

means for receiving a plurality of program segments from said library server via said 
communications facility 
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to .den^ « leas, 0TO mc ho, ^ prognnn ^ 

m ^ sesaon mto » ta pereeivalle ^ , ^ 

m^foriden^^^c™^^^^^^ 
^ior^ci^^^p^^,^^^ 

^ondaTer^fhrnto^^p^tftf^^^. 

hyperlink anchor passage is reproduced by said output means' 

^jpu. means fcr accept . hype** ex^don commons ftom a Uaener, Md 
n^respon^to^e^^^ ^ ^ 

^on pa^es ^ ^ ^ ^ ^ paffl ^J« 
^^o^of.nc^of^^.^^^^ 8 
^^^"^•..■^f^saidl^^^ 
tecr^p^^ mM^mmmmt^t^^^ 

•aidprogramschedulerhimsaldhliiBvseiver. 
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a mass storage device for storing a plurality of digitally recorded audio program 
segments, each of said segments haying a beginning and an end, and further storing data 
establishing a sequence in which said program segments are scheduled to be played, 

means for storing an associated program type designation for each of said recorded 
audio program: segments, 

input means for accepting control commands from a user, 
output means for producing audible sounds in response to analog audio signals, 
processing means for translating said digitally recorded audio program segments into 
analog audio signals delivered to said output means for reproducing said recorded 
program segments in a form audible to said user, said processing means being responsive 
to a user request for selectively inhibiting the reproduction of program segments specified 
by said user request . 



130. An audio program player as set forth in claim 129 wherein said program type 
is designations include designations of announcement program segments and wherein said 

means for selectively inhibiting comprises means for inhibiting the reproduction of 
program segments designated as being announcement program segments. 

13 1. An audio program player as set forth in claim 129 wherein said program type 
20 designations include designations of advertisement program segments and wherein said 

means for selectively inhibiting comprises means for mhibiting the reproduction of 
program segments designated as being advertisement program segments. 

132. A system for reproducing selected program segments containing audio presentations 
25 from a program library comprising, in combination: 

a library server storing said program library, 

^ a cmmunications facility for transferring selected program segments from said library 

server to player devices located remotely from said program library in response to 
program segment requests from said player devices, each of said player devices 

30 • . comprising: 
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communications facility. 

■n Mid session into an audible fonn perceivable by « ^ma 

Wfflsnuttag. npan for m ^ ^ ^ ^ ^ 

133. A ^fc«P^^pn, gmM ^ MMtfbrthinclrim , 6 

^"^P^s^vusddeonnn^^^ 

server, • 



134. A ^^^»ly fK ^.^^^^ min . 
to a listener «>mprisiiig>c^ 
storing each of said separate progranuhing segments as a file of digital data, 
^'^«««rfcon trolre cor«.^^. p ^ seqI ^ iiiwli . ch 

saia programming segments are to be reproduced, 

r' 0rPaS34Seh OM - «» <**. beginning of en routed 

anted passage in one of said files, 

pres^^,eg n ^ to , aid ^ tth ^^^ s9 ^ iiiresi)oiis 
said first set of control records, 

^aiu^con^lromsaidl^ 
with the presentationof said anchor passage, and 

re^rningthe presentation of said segments at the location of the begimu^ 
asodated linked passage. ' 1 Sud 
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135. The method as set forth in claim 134 further including the step of accepting a skip 
command from said listener during the presentation of at least selected ones of said 
programming segments and resuming the presentation of said segments at the beginning 
of the next segment in said proposed sequence in response to said skip amimand. 

5 136. The method of claim 135 further wherein some of said segments are subject 
description segments, which precede programming segments described thereby, said 
method further comprising the step, performed in response to said skip command when 
a subject description segment is being presented, of resuming me presentation of said 
segments at me beginning of the next subject description segment in said proposed 

10 sequence. 

137. The method of claim 134 further comprising the step of storing a file of digital data 
representing a file of natural language characters fonning a transcript of at least a 
transcribed one of said audio programming segments and further storing a third set of data 
representing locations within said transcribed audio program segment 6f corresponding 

15 locations in said file of characters. 

138. I1»einethodof<tol37mdua^Ae 

to said user, accepting from said listener the designation of a selected location within said 
displayed file of natural language text, and responsive to said designation presenting said 
. transcribed audio segment to said listener at a position in said transcribed audio segment 
20 corresponding to. said selected location in said file of characters. 
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